2026-01-28 19:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 19:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 19:00:04 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2026-01-28 19:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 19:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 19:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 19:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 19:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 17fd1440fc0a671d
2026-01-28 19:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-01-28 19:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2026-01-28T19_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-01-28 19:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 19:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 19:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 19:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 19:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 19:00:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 19:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-28 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-28 19:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 19:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 19:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 19:00:05 [scrapy.core.engine] INFO: Spider opened
2026-01-28 19:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 19:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-01-28 19:00:05 [scrapy-playwright] INFO: Starting download handler
2026-01-28 19:00:05 [scrapy-playwright] INFO: Starting download handler
2026-01-28 19:00:10 [scrapy-playwright] INFO: Launching browser firefox
2026-01-28 19:00:11 [scrapy-playwright] INFO: Browser firefox launched
2026-01-28 19:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-01-28 19:00:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-01-28 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2026-01-28 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2026-01-28 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B-t4WrpL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B-t4WrpL.js>
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2026-01-28 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-B-t4WrpL.js)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-B-t4WrpL.js)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2026-01-28 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/c0e38e93-2aa8-4b73-bd43-c1132b1048cf/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/c0e38e93-2aa8-4b73-bd43-c1132b1048cf/en.json>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/582fd0cc-f4d5-4c4f-83b4-5d5b88649c13_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/582fd0cc-f4d5-4c4f-83b4-5d5b88649c13_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/AO67YTV/2026-01-26/image/fb78ed09-022a-4deb-b8f1-4b46f641dbdd_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/AO67YTV/2026-01-26/image/fb78ed09-022a-4deb-b8f1-4b46f641dbdd_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/GU21MHO/2026-01-21/image/e75437f1-3434-4eb8-b6c9-1327eb74e1b4_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/GU21MHO/2026-01-21/image/e75437f1-3434-4eb8-b6c9-1327eb74e1b4_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/NU65ORN/2026-01-15/image/f5a179cf-302a-4525-ab65-a58eacea5282_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/NU65ORN/2026-01-15/image/f5a179cf-302a-4525-ab65-a58eacea5282_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SF66ZXM/2026-01-02/image/75c32062-ff63-4a0f-a368-a476cdaf78df_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SF66ZXM/2026-01-02/image/75c32062-ff63-4a0f-a368-a476cdaf78df_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/EJ61YTG/2026-01-23/image/739f165f-d460-44f8-89eb-1d076557c206_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/EJ61YTG/2026-01-23/image/739f165f-d460-44f8-89eb-1d076557c206_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SB15USO/2026-01-23/image/0f8f6e32-5d52-4876-a88a-61c70b414077_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SB15USO/2026-01-23/image/0f8f6e32-5d52-4876-a88a-61c70b414077_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/D22TTP/2026-01-21/image/68f8b1cb-9dba-4710-8d75-153640f2cfd5_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/D22TTP/2026-01-21/image/68f8b1cb-9dba-4710-8d75-153640f2cfd5_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/L28TLA/2026-01-21/image/1aae35be-4b12-4337-9200-4e1924b37b33_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/L28TLA/2026-01-21/image/1aae35be-4b12-4337-9200-4e1924b37b33_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/aad34d71-0873-437e-bffa-f091f85e9cd6_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/aad34d71-0873-437e-bffa-f091f85e9cd6_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/KF72VFU/2026-01-24/image/0921c0e4-f826-426e-87cd-5480d7b9325b_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/KF72VFU/2026-01-24/image/0921c0e4-f826-426e-87cd-5480d7b9325b_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LV72GVL/2025-12-16/image/8d2039f2-4462-4f59-a6df-2b5069165f06_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LV72GVL/2025-12-16/image/8d2039f2-4462-4f59-a6df-2b5069165f06_removebg.jpg?w=600>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcCenter.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCenterRounded.json>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcCenter.json>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_company_logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_company_logo.png>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2026-01-28 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2026-01-28 19:00:17 [astonbarclay.gb] INFO: Cookies from Playwright: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Wed+Jan+28+2026+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/', 'expires': 1801162817, 'httpOnly': False, 'secure': False, 'sameSite': 'Lax'}]
2026-01-28 19:00:17 [astonbarclay.gb] INFO: Scrapy-formatted cookies: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Wed+Jan+28+2026+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/'}]
2026-01-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2026-01-28 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2026-01-28 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2026-01-28 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118776794
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118776794%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118776794: 2
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118958793
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118958793%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118958793: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118853689
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118853689%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118853689: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118186650
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118186650%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118186650: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118954005
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118954005%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118954005: 2
2026-01-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118819931
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118819931%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118819931: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118002673
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118002673%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118002673: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118925344
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925344%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118925344: 2
2026-01-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117701973
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117701973%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117701973: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118468859
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118468859%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118468859: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118898479
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118898479%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118898479: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118597391
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118597391%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118597391: 2
2026-01-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118224076
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118224076%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118224076: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117023522: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118943801
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118943801%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118943801: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118997024
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118997024%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118997024: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118736863
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118736863%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118736863: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118343221
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118343221%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118343221: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118997130
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118997130%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118997130: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118836285
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118836285%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118836285: 2
2026-01-28 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118985189
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118985189%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118985189: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118344212
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118344212%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118344212: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118344048
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118344048%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118344048: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118758398
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118758398%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118758398: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118406584
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118406584%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118406584: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118892744
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118892744%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118892744: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118893571
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118893571%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118893571: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116509919: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118836325
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118836325%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118836325: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118997044
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118997044%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118997044: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116930521
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930521%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116930521: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118320461
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118320461%27 HTTP/1.1" 200 None
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Scrape type for 118320461: 0
2026-01-28 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 118178311
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118178311%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118178311: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118875853
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118875853%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118875853: 2
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118875895
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118875895%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118875895: 2
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118925324
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925324%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118925324: 2
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118925337
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925337%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118925337: 2
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118188404
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118188404%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118188404: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118472270
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118472270%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118472270: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118154265
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118154265%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118154265: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117587825
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587825%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117587825: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117830350
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117830350%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117830350: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117831420
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831420%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117831420: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118633494
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118633494%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118633494: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117824536
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117824536%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117824536: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563400
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563400%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563400: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118974170
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974170%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118974170: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116496702: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563389
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563389%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563389: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118338434
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118338434%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118338434: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118974161
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974161%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118974161: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116016591: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118343444
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118343444%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118343444: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118633474
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118633474%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118633474: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563411
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563411%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563411: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563449
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563449%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563449: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118633506
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118633506%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118633506: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563467
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563467%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563467: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563423
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563423%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563423: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117824413
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117824413%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117824413: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118563486
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563486%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118563486: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118343460
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118343460%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118343460: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118333789
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118333789%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118333789: 1
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116931547: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 119046283
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119046283%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 119046283: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118135535
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118135535%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118135535: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118457444
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118457444%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118457444: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118441782
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118441782%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118441782: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118431850
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118431850%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118431850: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117864929
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117864929%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117864929: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117831399
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831399%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117831399: 2
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117864943
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117864943%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117864943: 2
2026-01-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118954005?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118776794?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118925344?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118891424
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118891424%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118891424: 2
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118382790
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118382790%27 HTTP/1.1" 200 None
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Scrape type for 118382790: 0
2026-01-28 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 118736173
2026-01-28 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118736173%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118736173: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118750754
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118750754%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118750754: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118307675
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118307675%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118307675: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118698825
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118698825%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118698825: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118387288
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118387288%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118387288: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118683224
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118683224%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118683224: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118570661
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118570661%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118570661: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118234244
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118234244%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118234244: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118409448
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118409448%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118409448: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118994838
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994838%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118994838: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118838205
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118838205%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118838205: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118721162
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118721162%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118721162: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118987089
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987089%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118987089: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118069737
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118069737%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118069737: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118721100
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118721100%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118721100: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118262396
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118262396%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118262396: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118777639
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118777639%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118777639: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118531316
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118531316%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118531316: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118720475
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720475%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118720475: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118720621
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720621%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118720621: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118720677
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720677%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118720677: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118722378
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118722378%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118722378: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 119055495
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119055495%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 119055495: 0
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 118214401
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118214401%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 118214401: 2
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117884470
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117884470%27 HTTP/1.1" 200 None
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117884470: 2
2026-01-28 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118597391?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118875853?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118875895?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118836285?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118925324?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118954005, 'registration': 'SJ06DAZ', 'account': 'MAN037', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 3 5dr', 'mileage': 63230, 'mileageWarranty': False, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1027, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-11-20', 'fuel': 'Diesel', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/aad34d71-0873-437e-bffa-f091f85e9cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/fe23bf8f-3f5f-4bc6-9ba1-d7733603f851_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/fbbf6bfd-2ddf-4341-9342-ae1ecf4186e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/7db1fc0f-aa43-402b-8771-3bc62daeda64_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/15e35e47-380b-4550-ab03-6f582772d65d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/b0f41449-69db-4a73-8ed4-66fdf79ff239_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/b559c156-c155-4179-9dc8-68e20b1fe6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/d9219315-5fda-446a-be81-7a80236427d8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/18-6K, 01/21-16K, 02/22-22K, 02/24-44K', 'remarks': 'VOSA STATS - 29K, 41K, 51K, 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f1f26e70-b853-482e-b05d-1281237e0926.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118954005, 'registration': 'SJ06DAZ', 'account': 'MAN037', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 3 5dr', 'mileage': 63230, 'mileageWarranty': False, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1027, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-11-20', 'fuel': 'Diesel', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/aad34d71-0873-437e-bffa-f091f85e9cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/fe23bf8f-3f5f-4bc6-9ba1-d7733603f851_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/fbbf6bfd-2ddf-4341-9342-ae1ecf4186e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/7db1fc0f-aa43-402b-8771-3bc62daeda64_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/15e35e47-380b-4550-ab03-6f582772d65d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/b0f41449-69db-4a73-8ed4-66fdf79ff239_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/b559c156-c155-4179-9dc8-68e20b1fe6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ06DAZ/2026-01-23/image/d9219315-5fda-446a-be81-7a80236427d8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/18-6K, 01/21-16K, 02/22-22K, 02/24-44K', 'remarks': 'VOSA STATS - 29K, 41K, 51K, 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f1f26e70-b853-482e-b05d-1281237e0926.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e61db1-0f06-5d0a-a542-e36ddce47f2c with identifier: 118954005
2026-01-28 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e61db1-0f06-5d0a-a542-e36ddce47f2c with scrape type 2
2026-01-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e61db1-0f06-5d0a-a542-e36ddce47f2c with scrape type 2
2026-01-28 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61e61db1-0f06-5d0a-a542-e36ddce47f2c, identifier: 118954005
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118776794, 'registration': 'MJ20EPE', 'account': 'MOT075', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 132712, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1002, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-06-09', 'fuel': 'Electric', 'motExpiry': '2026-07-31', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/582fd0cc-f4d5-4c4f-83b4-5d5b88649c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/bd65665f-46d5-4bfe-8e8c-d9488d890da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/2a23f8fa-ee77-42ce-81d7-94998c1f1002_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/ce7f34df-3dbc-4905-897c-d8643afd9839_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/93c2cb5b-d9f3-4181-8acb-bd5b3e50f8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/63947af5-687a-4959-bd75-033b22be2992_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/388942cb-a972-4a7f-aaff-5fd546922a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/c4d25289-dbbb-4d11-a3a2-19e0fc327f3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/d3e30f4b-bbd3-4745-96fc-9a925dbecfb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/ebe8bb9a-96fa-4093-a752-184ac95d21af_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/5285f01a-1afe-4235-90f8-25efc8223c3d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 41K, 42K, 61K, 108K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c23e79b3-732e-4763-89a3-57230f67a744.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118776794, 'registration': 'MJ20EPE', 'account': 'MOT075', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 132712, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1002, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-06-09', 'fuel': 'Electric', 'motExpiry': '2026-07-31', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/582fd0cc-f4d5-4c4f-83b4-5d5b88649c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/bd65665f-46d5-4bfe-8e8c-d9488d890da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/2a23f8fa-ee77-42ce-81d7-94998c1f1002_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/ce7f34df-3dbc-4905-897c-d8643afd9839_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/93c2cb5b-d9f3-4181-8acb-bd5b3e50f8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/63947af5-687a-4959-bd75-033b22be2992_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/388942cb-a972-4a7f-aaff-5fd546922a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/c4d25289-dbbb-4d11-a3a2-19e0fc327f3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/d3e30f4b-bbd3-4745-96fc-9a925dbecfb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/ebe8bb9a-96fa-4093-a752-184ac95d21af_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ20EPE/2026-01-22/image/5285f01a-1afe-4235-90f8-25efc8223c3d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 41K, 42K, 61K, 108K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c23e79b3-732e-4763-89a3-57230f67a744.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with identifier: 118776794
2026-01-28 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with scrape type 2
2026-01-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with scrape type 2
2026-01-28 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ce5056d5-9f84-59bb-a7b5-a5d5a679c4db, identifier: 118776794
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118925344, 'registration': 'LV20YDL', 'account': 'AST061', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 Sport Executive 5dr', 'mileage': 37268, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1214, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV20YDL/2026-01-27/image/534b5d6d-872a-4bbe-909d-5b473610e369_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/660fd8f7-a2da-4a02-9e3a-d6cbe72afe5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/9063fb0f-2287-4457-a86c-f20096ef6628_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/3296b316-1235-4cf5-98c0-31b05aa7c219_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/aec7e7f4-e746-494a-a178-5ba1614825b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/c4de4c6f-fd82-49f8-9ebb-c96953975572_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/151977b6-dca3-4883-b2a8-3d8810823db0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/a4abc59f-b309-4c3d-83f3-e81eb2e79c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/25250d97-00a5-49c5-b0e7-8690e206d80d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21 3k - 03/22 7k - 04/23 16k - 05/25 33k -', 'remarks': 'VOSA STATES 15K- 25K - 34K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/51626e53-9e99-4a54-ad9e-08238ccdb004.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118925344, 'registration': 'LV20YDL', 'account': 'AST061', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 Sport Executive 5dr', 'mileage': 37268, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1214, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV20YDL/2026-01-27/image/534b5d6d-872a-4bbe-909d-5b473610e369_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/660fd8f7-a2da-4a02-9e3a-d6cbe72afe5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/9063fb0f-2287-4457-a86c-f20096ef6628_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/3296b316-1235-4cf5-98c0-31b05aa7c219_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/aec7e7f4-e746-494a-a178-5ba1614825b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/c4de4c6f-fd82-49f8-9ebb-c96953975572_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/151977b6-dca3-4883-b2a8-3d8810823db0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/a4abc59f-b309-4c3d-83f3-e81eb2e79c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV20YDL/2026-01-27/image/25250d97-00a5-49c5-b0e7-8690e206d80d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21 3k - 03/22 7k - 04/23 16k - 05/25 33k -', 'remarks': 'VOSA STATES 15K- 25K - 34K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/51626e53-9e99-4a54-ad9e-08238ccdb004.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bc5e39-5a8c-53bf-bd20-24cd8394861f with identifier: 118925344
2026-01-28 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bc5e39-5a8c-53bf-bd20-24cd8394861f with scrape type 2
2026-01-28 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bc5e39-5a8c-53bf-bd20-24cd8394861f with scrape type 2
2026-01-28 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f0bc5e39-5a8c-53bf-bd20-24cd8394861f, identifier: 118925344
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 119055506
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119055506%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 119055506: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118514604
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118514604%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118514604: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118535328
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118535328%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118535328: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118696494
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118696494%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118696494: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118722877
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118722877%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118722877: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118411454
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118411454%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118411454: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118071353
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118071353%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118071353: 0
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 118452050
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118452050%27 HTTP/1.1" 200 None
2026-01-28 19:00:23 [astonbarclay.gb] INFO: Scrape type for 118452050: 2
2026-01-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61e61db1-0f06-5d0a-a542-e36ddce47f2c with identifier: 118954005
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2026-01-28 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61e61db1-0f06-5d0a-a542-e36ddce47f2c with identifier: 118954005
2026-01-28 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 61e61db1-0f06-5d0a-a542-e36ddce47f2c with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Diesel',
'id': '61e61db1-0f06-5d0a-a542-e36ddce47f2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SJ06DAZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118954005',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MITSUBISHI',
'model': 'OUTLANDER DIESEL ESTATE',
'odometer': 63230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-20',
'seller_name': 'Manamanx Ltd',
'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 3 5dr',
'transmission': 'manual',
'trim': '2.2 DI-D 3 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118954005%27 HTTP/1.1" 200 None
2026-01-28 19:00:25 [astonbarclay.gb] INFO: Saving data for 118954005: {'auction_closing_time': 1769594400.0, 'created_time': 1769195031.99605, 'last_price_update_time': 1769626825.341656}
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118954005') HTTP/1.1" 204 0
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with identifier: 118776794
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with identifier: 118776794
2026-01-28 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: ce5056d5-9f84-59bb-a7b5-a5d5a679c4db with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Electric',
'id': 'ce5056d5-9f84-59bb-a7b5-a5d5a679c4db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MJ20EPE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118776794',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'TESLA',
'model': 'MODEL 3 SALOON',
'odometer': 132712,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-09',
'seller_name': 'MotoNovo Finance',
'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 4dr Auto',
'vin': None,
'year': 2020}
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118776794%27 HTTP/1.1" 200 None
2026-01-28 19:00:25 [astonbarclay.gb] INFO: Saving data for 118776794: {'auction_closing_time': 1769594400.0, 'created_time': 1768936375.370165, 'last_price_update_time': 1769626825.621413}
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118776794') HTTP/1.1" 204 0
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f0bc5e39-5a8c-53bf-bd20-24cd8394861f with identifier: 118925344
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-01-28 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f0bc5e39-5a8c-53bf-bd20-24cd8394861f with identifier: 118925344
2026-01-28 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: f0bc5e39-5a8c-53bf-bd20-24cd8394861f with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f0bc5e39-5a8c-53bf-bd20-24cd8394861f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LV20YDL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118925344',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS HATCHBACK',
'odometer': 37268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-01',
'seller_name': 'Hedin Automotive',
'title': 'MERCEDES-BENZ A CLASS HATCHBACK A200 Sport Executive 5dr',
'transmission': 'manual',
'trim': 'A200 Sport Executive 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925344%27 HTTP/1.1" 200 None
2026-01-28 19:00:25 [astonbarclay.gb] INFO: Saving data for 118925344: {'auction_closing_time': 1769594400.0, 'created_time': 1769194852.659787, 'last_price_update_time': 1769626825.994277}
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118925344') HTTP/1.1" 204 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118723248
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723248%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118723248: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118214831
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118214831%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118214831: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118526995
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118526995%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118526995: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118530066
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118530066%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118530066: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118428967
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118428967%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118428967: 2
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118407494
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118407494%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118407494: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118443975
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118443975%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118443975: 0
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 118331887
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118331887%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Scrape type for 118331887: 2
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118597391, 'registration': 'LV71RZR', 'account': 'MER178', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT Premium 5dr EAT8', 'mileage': 28437, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1233, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-26', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV71RZR/2026-01-19/image/96bd6da9-80c4-44c2-ac26-486bffcd528f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/60be4ab0-e7f7-450d-918a-11320568d781_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/a1fc4c4e-1313-4c37-afca-76d91708a503_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/b94a0c5b-77d1-4d57-b292-00ad9aefca6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/308c1f37-2a56-47b2-89b3-b2e8bc182f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/8296cabb-3e02-4636-83ca-122d3a15da81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/0ea3e8d7-7089-4882-a1f5-7a370aab2d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/68544f42-9fee-4016-9c30-f54d5d1de2bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/6d592784-a933-47df-b717-a180b786d070_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/a2c47251-ad15-4b71-8856-f218362a1420_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'STOLEN/RECOVERED - Damage is rear end and front end VOSA STATES - 18K - 28K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/164470f6-985f-47ed-96c4-5547179e48af.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118597391, 'registration': 'LV71RZR', 'account': 'MER178', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT Premium 5dr EAT8', 'mileage': 28437, 'mileageWarranty': True, 'type': 'car', 'saleId': 18452, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 1233, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-26', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV71RZR/2026-01-19/image/96bd6da9-80c4-44c2-ac26-486bffcd528f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/60be4ab0-e7f7-450d-918a-11320568d781_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/a1fc4c4e-1313-4c37-afca-76d91708a503_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/b94a0c5b-77d1-4d57-b292-00ad9aefca6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/308c1f37-2a56-47b2-89b3-b2e8bc182f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/8296cabb-3e02-4636-83ca-122d3a15da81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/0ea3e8d7-7089-4882-a1f5-7a370aab2d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/68544f42-9fee-4016-9c30-f54d5d1de2bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/6d592784-a933-47df-b717-a180b786d070_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RZR/2026-01-19/image/a2c47251-ad15-4b71-8856-f218362a1420_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'STOLEN/RECOVERED - Damage is rear end and front end VOSA STATES - 18K - 28K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/164470f6-985f-47ed-96c4-5547179e48af.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fb00dd-f94e-55eb-97ae-210d79316380 with identifier: 118597391
2026-01-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fb00dd-f94e-55eb-97ae-210d79316380 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fb00dd-f94e-55eb-97ae-210d79316380 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f7fb00dd-f94e-55eb-97ae-210d79316380, identifier: 118597391
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118875853, 'registration': 'MT18VHH', 'account': 'ESS030', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr', 'mileage': 71079, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2304, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-06-01', 'fuel': 'Petrol', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT18VHH/2026-01-24/image/cd548903-26cb-4bde-bd86-91ed487ab949_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/490ae094-b9ec-4f47-8796-554aec1382ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/4aa6e032-24f4-4bc9-b21d-915dd4c7d351_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/1bd9fe06-cb9c-44c7-9ab8-211afef41c73_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/b50753e7-5979-4509-a47e-42a0a808c3a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/6a83155a-757d-4aab-a19a-083fadacf2a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/7d2a0ff7-3cbc-4e2f-a98a-f216c2f7bc9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/83dc06f7-835f-4ef3-aa49-bf9a1f534aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/0c0e11bf-6f81-4ee9-b5bf-837b3710ab11_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/0a74231d-e8cd-4a44-a7f0-8e4797bae35f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is side and minor dents/scratches VOSA STATES, 22K, 34K, 48K, 69K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118875853, 'registration': 'MT18VHH', 'account': 'ESS030', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr', 'mileage': 71079, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2304, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-06-01', 'fuel': 'Petrol', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT18VHH/2026-01-24/image/cd548903-26cb-4bde-bd86-91ed487ab949_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/490ae094-b9ec-4f47-8796-554aec1382ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/4aa6e032-24f4-4bc9-b21d-915dd4c7d351_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/1bd9fe06-cb9c-44c7-9ab8-211afef41c73_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/b50753e7-5979-4509-a47e-42a0a808c3a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/6a83155a-757d-4aab-a19a-083fadacf2a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/7d2a0ff7-3cbc-4e2f-a98a-f216c2f7bc9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/83dc06f7-835f-4ef3-aa49-bf9a1f534aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/0c0e11bf-6f81-4ee9-b5bf-837b3710ab11_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT18VHH/2026-01-24/image/0a74231d-e8cd-4a44-a7f0-8e4797bae35f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is side and minor dents/scratches VOSA STATES, 22K, 34K, 48K, 69K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf37661-44d8-549b-9de0-debe44511ab1 with identifier: 118875853
2026-01-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf37661-44d8-549b-9de0-debe44511ab1 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf37661-44d8-549b-9de0-debe44511ab1 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ccf37661-44d8-549b-9de0-debe44511ab1, identifier: 118875853
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118875895, 'registration': 'LF73KGG', 'account': 'ESS030', 'make': 'JAGUAR', 'model': 'F-PACE ESTATE', 'derivative': '2.0 P400e R-Dynamic HSE Black 5dr Auto AWD', 'mileage': 17280, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2309, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-01-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF73KGG/2026-01-24/image/c26dca0f-61d1-4af9-b60f-bdfcc9fce446_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/d68bfd80-c1c2-4a65-aa98-bccf995b9c54_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/bdbf072c-d7af-4bd4-a81c-ef95e461f7b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/10ac34b4-d136-45ab-aebc-01818fd13e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/917d7348-8a75-4cf3-a417-eb432f7055ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/ad4d8dc3-2bed-4040-b9d7-cbddf62e0f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/740eb4ee-4b05-474b-aa68-83c52dfb9e78_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/88e6e173-cc7b-4f9b-82c1-991453d24a7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/7211bbd0-2ec3-4e88-a11f-073b447f00da_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/f442d4e8-425b-45ad-8001-e07ce099c9f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/25 16K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/126c845a-1227-4933-ba0b-4108c62f74b1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118875895, 'registration': 'LF73KGG', 'account': 'ESS030', 'make': 'JAGUAR', 'model': 'F-PACE ESTATE', 'derivative': '2.0 P400e R-Dynamic HSE Black 5dr Auto AWD', 'mileage': 17280, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2309, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-01-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF73KGG/2026-01-24/image/c26dca0f-61d1-4af9-b60f-bdfcc9fce446_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/d68bfd80-c1c2-4a65-aa98-bccf995b9c54_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/bdbf072c-d7af-4bd4-a81c-ef95e461f7b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/10ac34b4-d136-45ab-aebc-01818fd13e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/917d7348-8a75-4cf3-a417-eb432f7055ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/ad4d8dc3-2bed-4040-b9d7-cbddf62e0f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/740eb4ee-4b05-474b-aa68-83c52dfb9e78_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/88e6e173-cc7b-4f9b-82c1-991453d24a7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/7211bbd0-2ec3-4e88-a11f-073b447f00da_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF73KGG/2026-01-24/image/f442d4e8-425b-45ad-8001-e07ce099c9f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/25 16K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/126c845a-1227-4933-ba0b-4108c62f74b1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with identifier: 118875895
2026-01-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 999ec7a3-1382-5137-a59c-90fbcf4d7b16, identifier: 118875895
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118836285, 'registration': 'BF21HCZ', 'account': 'CAR001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 54954, 'mileageWarranty': False, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2112, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/abf13e1a-cb49-4fb1-ba34-30ead4edeb55_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/51ce2ed8-1c7b-4c55-951d-ae6e72d415ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/6e2c2bcf-9cd4-49ce-8f7f-1ed1594a7b49_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/5de15b9d-d524-497a-827e-32b46e701a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/883bd895-c044-4b89-8d32-7a2d944c9f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/3a226f82-90ef-49d4-a8a9-4dcaf1bbf0b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/7ee79b99-9d89-4897-93c9-419bd622c983_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/d5f1018c-4b77-457a-b54c-7424c10df7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/53c84b0a-b991-4ed3-adab-673d05c049fa_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print PDI ONLY', 'remarks': 'VOSA STATES, 34K, 52K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666205c9-3f8b-4a01-9058-b3c5948e12b7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118836285, 'registration': 'BF21HCZ', 'account': 'CAR001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 54954, 'mileageWarranty': False, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2112, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/abf13e1a-cb49-4fb1-ba34-30ead4edeb55_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/51ce2ed8-1c7b-4c55-951d-ae6e72d415ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/6e2c2bcf-9cd4-49ce-8f7f-1ed1594a7b49_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/5de15b9d-d524-497a-827e-32b46e701a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/883bd895-c044-4b89-8d32-7a2d944c9f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/3a226f82-90ef-49d4-a8a9-4dcaf1bbf0b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/7ee79b99-9d89-4897-93c9-419bd622c983_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/d5f1018c-4b77-457a-b54c-7424c10df7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF21HCZ/2026-01-21/image/53c84b0a-b991-4ed3-adab-673d05c049fa_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print PDI ONLY', 'remarks': 'VOSA STATES, 34K, 52K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666205c9-3f8b-4a01-9058-b3c5948e12b7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd599c82-621f-5af6-b847-d68a7ebea829 with identifier: 118836285
2026-01-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd599c82-621f-5af6-b847-d68a7ebea829 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd599c82-621f-5af6-b847-d68a7ebea829 with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cd599c82-621f-5af6-b847-d68a7ebea829, identifier: 118836285
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118925324, 'registration': 'LR20OKF', 'account': 'ALL068', 'make': 'BMW', 'model': '2 SERIES CONVERTIBLE', 'derivative': '218i M Sport 2dr [Nav] Step Auto', 'mileage': 48233, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2313, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-06', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/LR20OKF/2026-01-27/image/88ffb3f7-e630-4382-9a8c-0a0bc03b5569_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/4fa98637-2f88-482d-b4ff-24e5c3633c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f9106c9f-6322-4543-ab16-a32dce8f5664_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/73382b51-007d-4a47-8bb0-43e175df5d44_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/7b066d31-8c39-4d6b-88f7-90ec508d37ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/5a870828-5814-46b9-9183-30df82dd6d55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f8c3d156-44ae-4fb5-8e12-dd57fdec62bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/153bf8fb-bd3e-4d81-91ae-8a02cc149b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/d120c439-70b8-4957-b125-6b8d05ea13a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/08d0167e-7daa-4c9f-b207-c8b601135567_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f4817df2-9a30-4f05-94e1-74ba6d3cb9f5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/22 16K - 02/23 18K', 'remarks': 'PHOTOCOPY OF V5 ONLY - VOSA STATES, 18K, 30K, 39K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Allen Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55ea649f-dc5d-4717-a513-415dda8d4bba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118925324, 'registration': 'LR20OKF', 'account': 'ALL068', 'make': 'BMW', 'model': '2 SERIES CONVERTIBLE', 'derivative': '218i M Sport 2dr [Nav] Step Auto', 'mileage': 48233, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2313, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-06', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/LR20OKF/2026-01-27/image/88ffb3f7-e630-4382-9a8c-0a0bc03b5569_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/4fa98637-2f88-482d-b4ff-24e5c3633c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f9106c9f-6322-4543-ab16-a32dce8f5664_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/73382b51-007d-4a47-8bb0-43e175df5d44_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/7b066d31-8c39-4d6b-88f7-90ec508d37ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/5a870828-5814-46b9-9183-30df82dd6d55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f8c3d156-44ae-4fb5-8e12-dd57fdec62bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/153bf8fb-bd3e-4d81-91ae-8a02cc149b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/d120c439-70b8-4957-b125-6b8d05ea13a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/08d0167e-7daa-4c9f-b207-c8b601135567_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR20OKF/2026-01-27/image/f4817df2-9a30-4f05-94e1-74ba6d3cb9f5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/22 16K - 02/23 18K', 'remarks': 'PHOTOCOPY OF V5 ONLY - VOSA STATES, 18K, 30K, 39K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Allen Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55ea649f-dc5d-4717-a513-415dda8d4bba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aef5a0c-3401-506e-9562-3aa4a83877ec with identifier: 118925324
2026-01-28 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aef5a0c-3401-506e-9562-3aa4a83877ec with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aef5a0c-3401-506e-9562-3aa4a83877ec with scrape type 2
2026-01-28 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2aef5a0c-3401-506e-9562-3aa4a83877ec, identifier: 118925324
2026-01-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f7fb00dd-f94e-55eb-97ae-210d79316380 with identifier: 118597391
2026-01-28 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f7fb00dd-f94e-55eb-97ae-210d79316380 with identifier: 118597391
2026-01-28 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: f7fb00dd-f94e-55eb-97ae-210d79316380 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7fb00dd-f94e-55eb-97ae-210d79316380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LV71RZR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118597391',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'PEUGEOT',
'model': '5008 ESTATE',
'odometer': 28437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-31',
'seller_name': 'Hedin Automotive',
'title': 'PEUGEOT 5008 ESTATE 1.2 PureTech GT Premium 5dr EAT8',
'transmission': 'automatic',
'trim': '1.2 PureTech GT Premium 5dr EAT8',
'vin': None,
'year': 2021}
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118597391%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Saving data for 118597391: {'auction_closing_time': 1769594400.0, 'created_time': 1768590553.941417, 'last_price_update_time': 1769626826.686547}
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118597391') HTTP/1.1" 204 0
2026-01-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ccf37661-44d8-549b-9de0-debe44511ab1 with identifier: 118875853
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2026-01-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ccf37661-44d8-549b-9de0-debe44511ab1 with identifier: 118875853
2026-01-28 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: ccf37661-44d8-549b-9de0-debe44511ab1 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ccf37661-44d8-549b-9de0-debe44511ab1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MT18VHH',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118875853',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 71079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-01',
'seller_name': 'SMC GROUP',
'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Zetec 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Zetec 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118875853%27 HTTP/1.1" 200 None
2026-01-28 19:00:26 [astonbarclay.gb] INFO: Saving data for 118875853: {'auction_closing_time': 1769594400.0, 'created_time': 1769281323.179767, 'last_price_update_time': 1769626826.862737}
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118875853') HTTP/1.1" 204 0
2026-01-28 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with identifier: 118875895
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2026-01-28 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2026-01-28 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with identifier: 118875895
2026-01-28 19:00:27 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 999ec7a3-1382-5137-a59c-90fbcf4d7b16 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 40,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '999ec7a3-1382-5137-a59c-90fbcf4d7b16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LF73KGG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118875895',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'JAGUAR',
'model': 'F-PACE ESTATE',
'odometer': 17280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-29',
'seller_name': 'SMC GROUP',
'title': 'JAGUAR F-PACE ESTATE 2.0 P400e R-Dynamic HSE Black 5dr Auto AWD',
'transmission': 'automatic',
'trim': '2.0 P400e R-Dynamic HSE Black 5dr Auto AWD',
'vin': None,
'year': 2024}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118875895%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Saving data for 118875895: {'auction_closing_time': 1769594400.0, 'created_time': 1769281311.532361, 'last_price_update_time': 1769626827.259785}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118875895') HTTP/1.1" 204 0
2026-01-28 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cd599c82-621f-5af6-b847-d68a7ebea829 with identifier: 118836285
2026-01-28 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cd599c82-621f-5af6-b847-d68a7ebea829 with identifier: 118836285
2026-01-28 19:00:27 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: cd599c82-621f-5af6-b847-d68a7ebea829 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 44,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': 'cd599c82-621f-5af6-b847-d68a7ebea829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BF21HCZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118836285',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE HATCHBACK',
'odometer': 54954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-05',
'seller_name': 'CarGiant',
'title': 'LAND ROVER RANGE ROVER EVOQUE HATCHBACK 1.5 P300e S 5dr Auto',
'transmission': 'automatic',
'trim': '1.5 P300e S 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118836285%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Saving data for 118836285: {'auction_closing_time': 1769594400.0, 'created_time': 1769022106.083931, 'last_price_update_time': 1769626827.292952}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118836285') HTTP/1.1" 204 0
2026-01-28 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2aef5a0c-3401-506e-9562-3aa4a83877ec with identifier: 118925324
2026-01-28 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2aef5a0c-3401-506e-9562-3aa4a83877ec with identifier: 118925324
2026-01-28 19:00:27 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 2aef5a0c-3401-506e-9562-3aa4a83877ec with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2aef5a0c-3401-506e-9562-3aa4a83877ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR20OKF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118925324',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'BMW',
'model': '2 SERIES CONVERTIBLE',
'odometer': 48233,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-27',
'seller_name': 'Allen Motor Group',
'title': 'BMW 2 SERIES CONVERTIBLE 218i M Sport 2dr [Nav] Step Auto',
'transmission': 'automatic',
'trim': '218i M Sport 2dr [Nav] Step Auto',
'vin': None,
'year': 2020}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925324%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Saving data for 118925324: {'auction_closing_time': 1769594400.0, 'created_time': 1769194872.322984, 'last_price_update_time': 1769626827.332383}
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118925324') HTTP/1.1" 204 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118474298
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118474298%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118474298: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118137143
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137143%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118137143: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118300300
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118300300%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118300300: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118407188
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118407188%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118407188: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118622426
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118622426%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118622426: 2
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118052235
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118052235%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118052235: 2
2026-01-28 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118188404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118925337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118472270?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118789320
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118789320%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118789320: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118934734
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118934734%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118934734: 2
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118222274
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118222274%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118222274: 2
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118536405
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118536405%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118536405: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118345992
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345992%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118345992: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118389116
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118389116%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118389116: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118345645
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345645%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118345645: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118721031
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118721031%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118721031: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118119437
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118119437%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118119437: 2
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118415181
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118415181%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118415181: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118345512
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345512%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118345512: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118721293
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118721293%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118721293: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118429473
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118429473%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118429473: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118531114
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118531114%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118531114: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118720832
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720832%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118720832: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118603330
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118603330%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118603330: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118697940
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118697940%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118697940: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118500063
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118500063%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118500063: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118179849
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118179849%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118179849: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118037722
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118037722%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 118037722: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117362156: 0
2026-01-28 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 118474060
2026-01-28 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118474060%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118474060: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118534124
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534124%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118534124: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118362283
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118362283%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118362283: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118696370
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118696370%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118696370: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118429921
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118429921%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118429921: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118677546
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118677546%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118677546: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118516853
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118516853%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118516853: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118533660
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533660%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118533660: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118594798
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118594798%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118594798: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118685100
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118685100%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118685100: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118222441
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118222441%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118222441: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118262313
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118262313%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118262313: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118468119
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118468119%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118468119: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118735599
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735599%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118735599: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118207926
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118207926%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118207926: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118234125
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118234125%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118234125: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118973565
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118973565%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118973565: 2
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118188404, 'registration': 'VN67CVY', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P300 R-Dynamic HSE 5dr Auto', 'mileage': 49513, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2401, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-10-17', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN67CVY/2025-12-23/image/81fdd50d-8673-4c56-a43c-43305917d846_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/b72da246-3eee-405e-a454-34843eb8df00_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/0eef256a-da98-41cf-9555-6e443d19087f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/dfbbcf29-3f70-4787-a4bb-d9d861218979_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/018a13be-1d05-41e3-a760-9c8b6e5785cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/c44440cd-819d-4c3f-a57a-a7cca63cd937_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/2a0e677c-61ec-4c7e-a451-6bc23a94c87d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/640b0263-4931-4e3f-9837-2589067b6692_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/e9865821-8d68-4c2b-9e75-15dedbcc803e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/244ac203-1ce7-49f3-83e5-3e568270bd03_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/18 14K - 11/19 21K - 10/24 ?? - 03/25 ??', 'remarks': 'VOSA STATES 28K - 32K- 35K - 42K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 178, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88f8417d-958c-444d-ba26-4c95ee60c6a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118188404, 'registration': 'VN67CVY', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P300 R-Dynamic HSE 5dr Auto', 'mileage': 49513, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2401, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-10-17', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN67CVY/2025-12-23/image/81fdd50d-8673-4c56-a43c-43305917d846_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/b72da246-3eee-405e-a454-34843eb8df00_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/0eef256a-da98-41cf-9555-6e443d19087f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/dfbbcf29-3f70-4787-a4bb-d9d861218979_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/018a13be-1d05-41e3-a760-9c8b6e5785cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/c44440cd-819d-4c3f-a57a-a7cca63cd937_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/2a0e677c-61ec-4c7e-a451-6bc23a94c87d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/640b0263-4931-4e3f-9837-2589067b6692_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/e9865821-8d68-4c2b-9e75-15dedbcc803e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67CVY/2025-12-23/image/244ac203-1ce7-49f3-83e5-3e568270bd03_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/18 14K - 11/19 21K - 10/24 ?? - 03/25 ??', 'remarks': 'VOSA STATES 28K - 32K- 35K - 42K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 178, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88f8417d-958c-444d-ba26-4c95ee60c6a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b1135a-2987-5873-9a78-95f98607fa2c with identifier: 118188404
2026-01-28 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b1135a-2987-5873-9a78-95f98607fa2c with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b1135a-2987-5873-9a78-95f98607fa2c with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 85b1135a-2987-5873-9a78-95f98607fa2c, identifier: 118188404
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118925337, 'registration': 'GF20WKT', 'account': 'ALL068', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 Allure 5dr', 'mileage': 43341, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2316, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF20WKT/2026-01-26/image/ebeef283-4382-4f0f-9123-c9dbbd253a01_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/7c9062e3-7d3e-4891-9de6-54d04fbe83fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/fbf52bba-2a84-4de0-bf88-421d6b86375a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/6e88a602-17f0-4d0d-9821-bf0de285dad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/0752d8d8-a63c-4b51-89bf-f34123c714cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/019b7413-4170-438b-8bf7-053059b52e0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/7b39f86c-06e8-4d89-b2ce-d6736005c662_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/f58b2090-72c2-41e2-b036-b7bd2b177917_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/a94401d5-ba72-4741-bf1e-0b5c75b1f6ba_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22 15K - 12/23 25K - 03/25 ??', 'remarks': 'VOSA STATES, 21K, 33K, 39K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Allen Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35560747-7eeb-4041-9445-7137123067b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118925337, 'registration': 'GF20WKT', 'account': 'ALL068', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 Allure 5dr', 'mileage': 43341, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2316, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF20WKT/2026-01-26/image/ebeef283-4382-4f0f-9123-c9dbbd253a01_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/7c9062e3-7d3e-4891-9de6-54d04fbe83fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/fbf52bba-2a84-4de0-bf88-421d6b86375a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/6e88a602-17f0-4d0d-9821-bf0de285dad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/0752d8d8-a63c-4b51-89bf-f34123c714cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/019b7413-4170-438b-8bf7-053059b52e0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/7b39f86c-06e8-4d89-b2ce-d6736005c662_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/f58b2090-72c2-41e2-b036-b7bd2b177917_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF20WKT/2026-01-26/image/a94401d5-ba72-4741-bf1e-0b5c75b1f6ba_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22 15K - 12/23 25K - 03/25 ??', 'remarks': 'VOSA STATES, 21K, 33K, 39K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Allen Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35560747-7eeb-4041-9445-7137123067b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf87999-080a-5173-ae98-dcea59e06032 with identifier: 118925337
2026-01-28 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf87999-080a-5173-ae98-dcea59e06032 with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf87999-080a-5173-ae98-dcea59e06032 with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1cf87999-080a-5173-ae98-dcea59e06032, identifier: 118925337
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118472270, 'registration': 'KY67YTP', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL X HATCHBACK', 'derivative': '245kW 75kWh Dual Motor 5dr Auto', 'mileage': 116962, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2409, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Electric', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY67YTP/2026-01-09/image/fb2e48de-5636-4b70-8107-278eee6a28ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/3ed7564d-4e5b-4acc-b5c8-0aefef9cdf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/4643922f-17c7-4fba-976d-8352dcb06c5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/a291519b-204e-46bd-a7a3-e25d113c0250_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/861f6fa8-13d5-4913-8ff8-d63c48db936b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/1f7bc702-72a2-4682-89e9-349a3d7c95a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/d7479af6-fff1-49b8-8795-690cac3ed4b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/b9f4943d-5f49-4587-9505-504b4a691cd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/5fc0d658-567f-490d-916a-e71d3c816271_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/59a9239f-ee9c-44a7-8063-3cf9929bb058_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/552adfff-1550-4bd3-a74c-a77437b6546a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 68K - 76K - 90K- 105K -', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d0891c3-9277-49e0-b2c2-eb63c9c700d5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118472270, 'registration': 'KY67YTP', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL X HATCHBACK', 'derivative': '245kW 75kWh Dual Motor 5dr Auto', 'mileage': 116962, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2409, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Electric', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY67YTP/2026-01-09/image/fb2e48de-5636-4b70-8107-278eee6a28ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/3ed7564d-4e5b-4acc-b5c8-0aefef9cdf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/4643922f-17c7-4fba-976d-8352dcb06c5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/a291519b-204e-46bd-a7a3-e25d113c0250_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/861f6fa8-13d5-4913-8ff8-d63c48db936b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/1f7bc702-72a2-4682-89e9-349a3d7c95a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/d7479af6-fff1-49b8-8795-690cac3ed4b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/b9f4943d-5f49-4587-9505-504b4a691cd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/5fc0d658-567f-490d-916a-e71d3c816271_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/59a9239f-ee9c-44a7-8063-3cf9929bb058_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67YTP/2026-01-09/image/552adfff-1550-4bd3-a74c-a77437b6546a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 68K - 76K - 90K- 105K -', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d0891c3-9277-49e0-b2c2-eb63c9c700d5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25de1b9f-1226-5683-9824-accdf8443658 with identifier: 118472270
2026-01-28 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25de1b9f-1226-5683-9824-accdf8443658 with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25de1b9f-1226-5683-9824-accdf8443658 with scrape type 2
2026-01-28 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 25de1b9f-1226-5683-9824-accdf8443658, identifier: 118472270
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118515253
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118515253%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118515253: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118533606
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533606%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118533606: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118572978
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118572978%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118572978: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118707176
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118707176%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118707176: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118113792
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118113792%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118113792: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118517240
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118517240%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118517240: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118563692
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563692%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118563692: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118715977
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118715977%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118715977: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118346054
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118346054%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118346054: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118720925
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720925%27 HTTP/1.1" 200 None
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Scrape type for 118720925: 0
2026-01-28 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 118939194
2026-01-28 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118939194%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118939194: 2
2026-01-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 85b1135a-2987-5873-9a78-95f98607fa2c with identifier: 118188404
2026-01-28 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 85b1135a-2987-5873-9a78-95f98607fa2c with identifier: 118188404
2026-01-28 19:00:29 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 85b1135a-2987-5873-9a78-95f98607fa2c with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 178,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85b1135a-2987-5873-9a78-95f98607fa2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VN67CVY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118188404',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'LAND ROVER',
'model': 'RANGE ROVER VELAR ESTATE',
'odometer': 49513,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-17',
'seller_name': 'Mann Island Finance',
'title': 'LAND ROVER RANGE ROVER VELAR ESTATE 2.0 P300 R-Dynamic HSE 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 P300 R-Dynamic HSE 5dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118188404%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Saving data for 118188404: {'auction_closing_time': 1769594400.0, 'created_time': 1769281289.532163, 'last_price_update_time': 1769626829.028911}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118188404') HTTP/1.1" 204 0
2026-01-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1cf87999-080a-5173-ae98-dcea59e06032 with identifier: 118925337
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=YELLOW HTTP/1.1" 200 None
2026-01-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1cf87999-080a-5173-ae98-dcea59e06032 with identifier: 118925337
2026-01-28 19:00:29 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 1cf87999-080a-5173-ae98-dcea59e06032 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'YELLOW',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1cf87999-080a-5173-ae98-dcea59e06032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GF20WKT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118925337',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'PEUGEOT',
'model': '208 HATCHBACK',
'odometer': 43341,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seller_name': 'Allen Motor Group',
'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 100 Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 100 Allure 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925337%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Saving data for 118925337: {'auction_closing_time': 1769594400.0, 'created_time': 1769194852.226633, 'last_price_update_time': 1769626829.281314}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118925337') HTTP/1.1" 204 0
2026-01-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 25de1b9f-1226-5683-9824-accdf8443658 with identifier: 118472270
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2026-01-28 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 25de1b9f-1226-5683-9824-accdf8443658 with identifier: 118472270
2026-01-28 19:00:29 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 25de1b9f-1226-5683-9824-accdf8443658 with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Electric',
'id': '25de1b9f-1226-5683-9824-accdf8443658',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KY67YTP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472270',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'TESLA',
'model': 'MODEL X HATCHBACK',
'odometer': 116962,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-30',
'seller_name': 'Mann Island Finance',
'title': 'TESLA MODEL X HATCHBACK 245kW 75kWh Dual Motor 5dr Auto',
'transmission': 'automatic',
'trim': '245kW 75kWh Dual Motor 5dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118472270%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Saving data for 118472270: {'auction_closing_time': 1769594400.0, 'created_time': 1769195001.172715, 'last_price_update_time': 1769626829.450012}
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118472270') HTTP/1.1" 204 0
2026-01-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117831420?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117830350?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116496702?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118154265?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118307737
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118307737%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118307737: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118723304
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723304%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118723304: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118455536
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118455536%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118455536: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118442971
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118442971%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118442971: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118714509
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118714509%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118714509: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118292435
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118292435%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118292435: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118744120
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118744120%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118744120: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118041591
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118041591%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118041591: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118534305
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534305%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118534305: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118727918
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118727918%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118727918: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118526874
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118526874%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118526874: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118685430
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118685430%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118685430: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118602856
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118602856%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118602856: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118645456
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118645456%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118645456: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118403737
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118403737%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118403737: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118681006
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118681006%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118681006: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118179733
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118179733%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118179733: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118533731
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533731%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118533731: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118571579
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118571579%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118571579: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118534775
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534775%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118534775: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118720075
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720075%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118720075: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118223011
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118223011%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118223011: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118566174
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118566174%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118566174: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118711011
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118711011%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118711011: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118555601
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118555601%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118555601: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118735652
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735652%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118735652: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118567749
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118567749%27 HTTP/1.1" 200 None
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Scrape type for 118567749: 0
2026-01-28 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 118319826
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118319826%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118319826: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118496548
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118496548%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118496548: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118757868
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118757868%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118757868: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118345564
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345564%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118345564: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118684044
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118684044%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118684044: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118696042
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118696042%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118696042: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118292543
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118292543%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118292543: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118409489
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118409489%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118409489: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118672808
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118672808%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118672808: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118622315
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118622315%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118622315: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118567666
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118567666%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118567666: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118582220
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118582220%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118582220: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118557714
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118557714%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118557714: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118682603
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118682603%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118682603: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118719131
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118719131%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118719131: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118596421
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118596421%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118596421: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118559928
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118559928%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118559928: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118411824
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118411824%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118411824: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118656014
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118656014%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118656014: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118603538
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118603538%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118603538: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118685648
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118685648%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118685648: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118292406
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118292406%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118292406: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118558973
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118558973%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118558973: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117695970
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695970%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117695970: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118403554
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118403554%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118403554: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118838708
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118838708%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118838708: 1
2026-01-28 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116016591?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118474211
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118474211%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118474211: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 113584996
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27113584996%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 113584996: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118721281
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118721281%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118721281: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118429718
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118429718%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118429718: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118569384
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118569384%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118569384: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118261211
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118261211%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118261211: 1
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118604233
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118604233%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118604233: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118738669
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118738669%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118738669: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118824108
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118824108%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118824108: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118654506
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654506%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118654506: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116178889
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116178889%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116178889: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118058782
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118058782%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118058782: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739450
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739450%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739450: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118702450
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118702450%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118702450: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739301
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739301%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739301: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118607790
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118607790%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118607790: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739478
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739478%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739478: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118751284
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118751284%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118751284: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118824542
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118824542%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118824542: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739422
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739422%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739422: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118654488
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654488%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118654488: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739437
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739437%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739437: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118836835
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118836835%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118836835: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739270
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739270%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739270: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118654450
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654450%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118654450: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118654469
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654469%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118654469: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739279
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739279%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739279: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739513
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739513%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739513: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 118739321
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739321%27 HTTP/1.1" 200 None
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Scrape type for 118739321: 0
2026-01-28 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117703677
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117703677%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117703677: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118654432
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654432%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118654432: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118436680
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118436680%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118436680: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118436925
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118436925%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118436925: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118698408
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118698408%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118698408: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118739222
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739222%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118739222: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118656608
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118656608%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118656608: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118686898
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118686898%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118686898: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118654459
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654459%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118654459: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118610424
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118610424%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118610424: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118710668
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118710668%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118710668: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118987826
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987826%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118987826: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118739292
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739292%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118739292: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118654497
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654497%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118654497: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118914312
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118914312%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118914312: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118898120
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118898120%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118898120: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118436730
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118436730%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118436730: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118779424
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118779424%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118779424: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117902579
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117902579%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117902579: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118436703
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118436703%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118436703: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118654479
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654479%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118654479: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118739245
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739245%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118739245: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118976475
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118976475%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118976475: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118792557
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118792557%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118792557: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118811975
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811975%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118811975: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118654373
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654373%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118654373: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118739236
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739236%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118739236: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118889013
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118889013%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118889013: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118942100
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118942100%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118942100: 0
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 118953718
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953718%27 HTTP/1.1" 200 None
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Scrape type for 118953718: 2
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117831420, 'registration': 'RJ72ZBX', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 99290, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 1, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-17', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/17a0e6df-00dd-487c-9abb-526031dd03f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/a1a9f02d-2f47-4902-b134-de476cf5a8a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/2b1b15ec-65c9-4185-94f1-372e031496cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/66ed9b0f-eb64-4c60-8d0e-90342118b8ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/b90b092e-558c-4456-80bb-1e883cbdfc26_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/50fcea0a-c0a3-4d7c-aee7-8fb3ae535c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/b4f4c735-438b-4dc6-8ef2-7b62549fdc98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/a25b449e-91b0-4bd8-83fd-a68c493d06a6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23 43k 11/24 71k', 'remarks': 'Ex-Private Hire, SPARE KEY, VOSA STATES 19K 43K 64K 77K 86K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac6778fe-404c-41dd-a008-47987d6ecbbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117831420, 'registration': 'RJ72ZBX', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 99290, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 1, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-17', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/17a0e6df-00dd-487c-9abb-526031dd03f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/a1a9f02d-2f47-4902-b134-de476cf5a8a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/2b1b15ec-65c9-4185-94f1-372e031496cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/66ed9b0f-eb64-4c60-8d0e-90342118b8ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/b90b092e-558c-4456-80bb-1e883cbdfc26_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/50fcea0a-c0a3-4d7c-aee7-8fb3ae535c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/b4f4c735-438b-4dc6-8ef2-7b62549fdc98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBX/2025-12-16/image/a25b449e-91b0-4bd8-83fd-a68c493d06a6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23 43k 11/24 71k', 'remarks': 'Ex-Private Hire, SPARE KEY, VOSA STATES 19K 43K 64K 77K 86K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac6778fe-404c-41dd-a008-47987d6ecbbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 with identifier: 117831420
2026-01-28 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 with scrape type 2
2026-01-28 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 with scrape type 2
2026-01-28 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4, identifier: 117831420
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117830350, 'registration': 'RF72GAO', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 91539, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 0, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72GAO/2025-12-11/image/093f8695-52eb-4026-afd0-e8781f48dea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/2d72aefa-2c34-4846-9933-024f32bc3b2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ee28eced-92ac-4ccf-a9a3-9fb31b2e12ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ed7ecc3e-79a3-4ce3-a1b6-65f3099de489_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/e77a1d3b-2a7d-4450-948e-c1060773600e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/b0b0df38-ebbb-48e5-8f0e-cdcc02a4e0fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/964e072f-9861-42cc-a2c1-1f300b2dbd01_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ce32df23-c538-4b6d-a69d-1b5152dbb1b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/a256623b-0537-4571-8c34-40778a4a8787_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/f54ef866-8fa2-4c28-b48a-b0343ef42344_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 43K - 12/24 71K', 'remarks': 'Ex-Private Hire - VOSA STATES, 52K, 65K, 75K, 91K - SPARE KEY I N OFFICE', 'virtual': True, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9ab60af9-186c-460d-ac2f-7ec124ba12e7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117830350, 'registration': 'RF72GAO', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 91539, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 0, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72GAO/2025-12-11/image/093f8695-52eb-4026-afd0-e8781f48dea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/2d72aefa-2c34-4846-9933-024f32bc3b2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ee28eced-92ac-4ccf-a9a3-9fb31b2e12ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ed7ecc3e-79a3-4ce3-a1b6-65f3099de489_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/e77a1d3b-2a7d-4450-948e-c1060773600e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/b0b0df38-ebbb-48e5-8f0e-cdcc02a4e0fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/964e072f-9861-42cc-a2c1-1f300b2dbd01_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/ce32df23-c538-4b6d-a69d-1b5152dbb1b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/a256623b-0537-4571-8c34-40778a4a8787_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72GAO/2025-12-11/image/f54ef866-8fa2-4c28-b48a-b0343ef42344_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 43K - 12/24 71K', 'remarks': 'Ex-Private Hire - VOSA STATES, 52K, 65K, 75K, 91K - SPARE KEY I N OFFICE', 'virtual': True, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9ab60af9-186c-460d-ac2f-7ec124ba12e7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 with identifier: 117830350
2026-01-28 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 with scrape type 2
2026-01-28 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 with scrape type 2
2026-01-28 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0, identifier: 117830350
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116496702, 'registration': 'VN25ZXV', 'account': 'LIQ001', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 676, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 5, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/6240b492-d2fa-46bb-a5af-2cebabc6130a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/3398cc38-7948-478b-a428-87f090ea9a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/fc62756b-6a5b-44b9-b205-a89176ec09b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/55414cc6-bcc5-47d5-8ea0-670ae12efe86_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/5ec0c209-db7b-4612-af7f-1381e70cc611_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/0b240c5a-bf6d-4aa0-bb28-92e53d0254fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/1a18063c-0412-457f-a4cd-ac0daad12416_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/c259c8bd-5202-4e48-b1be-dbb62f151400_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa46cc0a-7a3a-44b1-a66f-0779e1eae991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116496702, 'registration': 'VN25ZXV', 'account': 'LIQ001', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 676, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 5, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/6240b492-d2fa-46bb-a5af-2cebabc6130a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/3398cc38-7948-478b-a428-87f090ea9a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/fc62756b-6a5b-44b9-b205-a89176ec09b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/55414cc6-bcc5-47d5-8ea0-670ae12efe86_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/5ec0c209-db7b-4612-af7f-1381e70cc611_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/0b240c5a-bf6d-4aa0-bb28-92e53d0254fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/1a18063c-0412-457f-a4cd-ac0daad12416_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/c259c8bd-5202-4e48-b1be-dbb62f151400_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa46cc0a-7a3a-44b1-a66f-0779e1eae991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2026-01-28 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with scrape type 2
2026-01-28 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with scrape type 2
2026-01-28 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2, identifier: 116496702
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118154265, 'registration': 'LA21LLE', 'account': 'MAN027', 'make': 'AUDI', 'model': 'E-TRON SPORTBACK', 'derivative': '300kW 55 Quattro 95kWh S Line 5dr Auto', 'mileage': 71549, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2411, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-09', 'fuel': 'Electric', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA21LLE/2026-01-21/image/c35a6c41-25b5-412f-8326-bacd6a0107b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/1a672c8b-2a6e-4250-a46d-aedd5e877d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/a839ee66-40a9-4fdd-b0d8-5f31f1c5802c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/ecf4846f-f475-48d8-915f-5a8387636064_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/56d74026-f54c-416b-a8d9-6e33b7023fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/0863be7f-3841-4dfe-aa3f-7a812e042ad5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/f7ccdbc7-80e3-458a-9f42-05b87edcc393_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/33b03b13-b082-4fed-84e9-7379b5dc5d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/891eeadb-c146-4553-849d-b7ef3664716d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/66975a9b-83fe-4cd4-93c9-e65abcda02c3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K- 49K -', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ade366e9-1d1f-4f3a-be61-e5a0b6c22871.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118154265, 'registration': 'LA21LLE', 'account': 'MAN027', 'make': 'AUDI', 'model': 'E-TRON SPORTBACK', 'derivative': '300kW 55 Quattro 95kWh S Line 5dr Auto', 'mileage': 71549, 'mileageWarranty': True, 'type': 'car', 'saleId': 18451, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-28T10:00Z', 'lot': 2411, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-09', 'fuel': 'Electric', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA21LLE/2026-01-21/image/c35a6c41-25b5-412f-8326-bacd6a0107b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/1a672c8b-2a6e-4250-a46d-aedd5e877d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/a839ee66-40a9-4fdd-b0d8-5f31f1c5802c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/ecf4846f-f475-48d8-915f-5a8387636064_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/56d74026-f54c-416b-a8d9-6e33b7023fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/0863be7f-3841-4dfe-aa3f-7a812e042ad5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/f7ccdbc7-80e3-458a-9f42-05b87edcc393_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/33b03b13-b082-4fed-84e9-7379b5dc5d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/891eeadb-c146-4553-849d-b7ef3664716d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA21LLE/2026-01-21/image/66975a9b-83fe-4cd4-93c9-e65abcda02c3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K- 49K -', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ade366e9-1d1f-4f3a-be61-e5a0b6c22871.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with identifier: 118154265
2026-01-28 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with scrape type 2
2026-01-28 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with scrape type 2
2026-01-28 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 51787b07-b2cd-57cd-b8d0-4d20171b9f5f, identifier: 118154265
2026-01-28 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 with identifier: 117831420
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 with identifier: 117831420
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159791 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159791
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 spider: astonbarclay.gb
2026-01-28 19:00:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4 due to rule: high_mileage_for_country.json, error: 159791 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159791
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'f1cfc4ce-ea1e-5b8e-bb2f-1c97ac6f72a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ72ZBX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831420',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 99290,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831420%27 HTTP/1.1" 200 None
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Saving data for 117831420: {'auction_closing_time': 1769680800.0, 'created_time': 1767986491.962223, 'last_price_update_time': 1769626832.468513}
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117831420') HTTP/1.1" 204 0
2026-01-28 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 with identifier: 117830350
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 with identifier: 117830350
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 91539, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117830350', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rf72gao', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 147317} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rf72gao',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117830350',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 91539,
'odometer_in_km': 147317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 spider: astonbarclay.gb
2026-01-28 19:00:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 91539, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117830350', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rf72gao', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 147317} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rf72gao',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117830350',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 91539,
'odometer_in_km': 147317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '4fcb69f6-5c5a-56e7-9edd-ee8aead27ca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RF72GAO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117830350',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 91539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117830350%27 HTTP/1.1" 200 None
2026-01-28 19:00:32 [astonbarclay.gb] INFO: Saving data for 117830350: {'auction_closing_time': 1769680800.0, 'created_time': 1767987887.301856, 'last_price_update_time': 1769626832.781988}
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117830350') HTTP/1.1" 204 0
2026-01-28 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2026-01-28 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2026-01-28 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702 to the API
2026-01-28 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116496702?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3595f4f7-74a9-572e-a905-90eb5ce1a5f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VN25ZXV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116496702',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'PEUGEOT',
'model': '3008 ESTATE',
'odometer': 676,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-21',
'seller_name': 'Liquid Fleet',
'title': 'PEUGEOT 3008 ESTATE 1.2 Hybrid 136 GT 5dr e-DSC6',
'transmission': 'automatic',
'trim': '1.2 Hybrid 136 GT 5dr e-DSC6',
'vin': None,
'year': 2025}
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Saving data for 116496702: {'auction_closing_time': 1769680800.0, 'created_time': 1767986442.623806, 'last_price_update_time': 1769626833.24618}
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116496702') HTTP/1.1" 204 0
2026-01-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with identifier: 118154265
2026-01-28 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with identifier: 118154265
2026-01-28 19:00:33 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 51787b07-b2cd-57cd-b8d0-4d20171b9f5f with expiration date: 2026-01-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-28T10:00:00Z',
'fuel_type': 'Electric',
'id': '51787b07-b2cd-57cd-b8d0-4d20171b9f5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LA21LLE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118154265',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'AUDI',
'model': 'E-TRON SPORTBACK',
'odometer': 71549,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-09',
'seller_name': 'Mann Island Finance',
'title': 'AUDI E-TRON SPORTBACK 300kW 55 Quattro 95kWh S Line 5dr Auto',
'transmission': 'automatic',
'trim': '300kW 55 Quattro 95kWh S Line 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118154265%27 HTTP/1.1" 200 None
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Saving data for 118154265: {'auction_closing_time': 1769594400.0, 'created_time': 1769281326.82025, 'last_price_update_time': 1769626833.278102}
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118154265') HTTP/1.1" 204 0
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 118654354
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654354%27 HTTP/1.1" 200 None
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Scrape type for 118654354: 0
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 118790658
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118790658%27 HTTP/1.1" 200 None
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Scrape type for 118790658: 2
2026-01-28 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118431850?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117864943?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117831399?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116016591, 'registration': 'RV25UVT', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 15966, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 8, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV25UVT/2025-10-02/image/51d107d3-6a0d-40d9-9365-2699eaa52a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c68f1d1c-a453-4954-8571-1cb710f193c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/8a865e38-17d4-4bc0-93b8-0e53793b22ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/98b976cc-f091-4330-a10f-8365a4e7d8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/a737b923-d39e-4b37-beff-e76a6e3633bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/92393a48-768b-45e1-a4c5-b36d7f30e217_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c87c1800-f2e4-4880-b45c-77f8b944f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/d90156c8-1374-44c9-8a8c-720593805b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/7ac8dd29-0689-44c9-8cb7-29da899a351f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b66a2cb-dfba-4438-92a6-27e3e3d9796f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116016591, 'registration': 'RV25UVT', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 15966, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 8, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV25UVT/2025-10-02/image/51d107d3-6a0d-40d9-9365-2699eaa52a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c68f1d1c-a453-4954-8571-1cb710f193c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/8a865e38-17d4-4bc0-93b8-0e53793b22ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/98b976cc-f091-4330-a10f-8365a4e7d8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/a737b923-d39e-4b37-beff-e76a6e3633bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/92393a48-768b-45e1-a4c5-b36d7f30e217_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c87c1800-f2e4-4880-b45c-77f8b944f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/d90156c8-1374-44c9-8a8c-720593805b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/7ac8dd29-0689-44c9-8cb7-29da899a351f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b66a2cb-dfba-4438-92a6-27e3e3d9796f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2026-01-28 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5721406-ef77-5d92-96af-aa9c3f0a041d with scrape type 2
2026-01-28 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5721406-ef77-5d92-96af-aa9c3f0a041d with scrape type 2
2026-01-28 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b5721406-ef77-5d92-96af-aa9c3f0a041d, identifier: 116016591
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 118982822
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118982822%27 HTTP/1.1" 200 None
2026-01-28 19:00:33 [astonbarclay.gb] INFO: Scrape type for 118982822: 2
2026-01-28 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2026-01-28 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2026-01-28 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591 to the API
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116016591?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': 'b5721406-ef77-5d92-96af-aa9c3f0a041d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RV25UVT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116016591',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'KIA',
'model': 'SPORTAGE ESTATE',
'odometer': 15966,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-27',
'seller_name': 'Liquid Fleet',
'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi 207 HEV 3 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Saving data for 116016591: {'auction_closing_time': 1769680800.0, 'created_time': 1767986554.95419, 'last_price_update_time': 1769626834.023908}
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116016591') HTTP/1.1" 204 0
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 118654327
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654327%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Scrape type for 118654327: 0
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 118724278
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724278%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Scrape type for 118724278: 2
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 118739334
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739334%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Scrape type for 118739334: 0
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 118724241
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724241%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Scrape type for 118724241: 2
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118431850, 'registration': 'YK25RTU', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 10574, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 28, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-07', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK25RTU/2026-01-08/image/5790e693-4be7-4649-ac04-4f8eafcec99c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/f05454f7-9478-4d5c-83b2-24667c588bea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/10df9842-7f38-435b-bf99-26a38aaf1342_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/090a5874-326f-4bca-8c8c-593ad33361b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/d4e78a7b-d51b-4811-b6e7-3fa3d154e247_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/4a23e464-568e-4e1b-9f5d-cf0e4bbfb2f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/02ca0d19-697c-4daf-b754-556910cbd4a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/80587230-ade2-471c-b3d7-051d1298f28e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29ea63b0-1a78-4fd1-8c64-89899018a44b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118431850, 'registration': 'YK25RTU', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 10574, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 28, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-07', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK25RTU/2026-01-08/image/5790e693-4be7-4649-ac04-4f8eafcec99c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/f05454f7-9478-4d5c-83b2-24667c588bea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/10df9842-7f38-435b-bf99-26a38aaf1342_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/090a5874-326f-4bca-8c8c-593ad33361b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/d4e78a7b-d51b-4811-b6e7-3fa3d154e247_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/4a23e464-568e-4e1b-9f5d-cf0e4bbfb2f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/02ca0d19-697c-4daf-b754-556910cbd4a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTU/2026-01-08/image/80587230-ade2-471c-b3d7-051d1298f28e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29ea63b0-1a78-4fd1-8c64-89899018a44b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4402bfe9-7cec-576e-a88b-4343a0673ed5 with identifier: 118431850
2026-01-28 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4402bfe9-7cec-576e-a88b-4343a0673ed5 with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4402bfe9-7cec-576e-a88b-4343a0673ed5 with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4402bfe9-7cec-576e-a88b-4343a0673ed5, identifier: 118431850
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117864943, 'registration': 'RF72DZN', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 119639, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-08', 'fuel': 'Electric', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72DZN/2025-12-16/image/a14728cb-06b4-4257-8c30-2c6889f601b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/097015b4-e439-44ba-af44-e5d5a4598304_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/eba2ca2d-66c7-4d89-ba53-f6249edd6d22_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/16cfeb0c-d820-4dd4-945c-8e617f3fd2f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/e182a886-a296-442c-8ad9-3e17cad0b396_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/0a6e41e3-11a7-4f9c-a8de-8ccd0e90386b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/92ab3f1d-c2ae-406d-a397-b0f0a2a49886_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/e4bed58d-8197-43a4-b7df-ecfe80422d4a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23 35k 11/24 75k', 'remarks': 'Ex-Private Hire, VOSA STATES 14K 34K 55K 78K 99K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e77619c-3815-4bef-83cc-85a6df3be054.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117864943, 'registration': 'RF72DZN', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 119639, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-08', 'fuel': 'Electric', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72DZN/2025-12-16/image/a14728cb-06b4-4257-8c30-2c6889f601b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/097015b4-e439-44ba-af44-e5d5a4598304_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/eba2ca2d-66c7-4d89-ba53-f6249edd6d22_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/16cfeb0c-d820-4dd4-945c-8e617f3fd2f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/e182a886-a296-442c-8ad9-3e17cad0b396_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/0a6e41e3-11a7-4f9c-a8de-8ccd0e90386b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/92ab3f1d-c2ae-406d-a397-b0f0a2a49886_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72DZN/2025-12-16/image/e4bed58d-8197-43a4-b7df-ecfe80422d4a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23 35k 11/24 75k', 'remarks': 'Ex-Private Hire, VOSA STATES 14K 34K 55K 78K 99K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e77619c-3815-4bef-83cc-85a6df3be054.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a87ffef-4050-52fc-ac81-50f79488084e with identifier: 117864943
2026-01-28 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a87ffef-4050-52fc-ac81-50f79488084e with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a87ffef-4050-52fc-ac81-50f79488084e with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a87ffef-4050-52fc-ac81-50f79488084e, identifier: 117864943
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117831399, 'registration': 'RJ72ZBT', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 79396, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/f7009c5f-0304-49fe-bd94-e171b5b3864d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/cbb22978-24b9-4c15-9b7e-d7a2aa020288_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/97c04d19-085e-43ec-a631-0bf72fa76aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/2d4a6e2d-5fb1-4950-9a51-4af4b15c0205_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/ffefc1eb-6a8b-418e-8656-9589af78b246_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/aee92b28-5b79-4e90-936b-aa03f07ecf90_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/b5a7285b-98c0-467d-ac4e-c9bfecbee0fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/10f8953a-03c7-4e32-b929-e5891c4f677e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/24-28K 04/25-60K', 'remarks': 'Ex-Private Hire, SPARE KEY, VOSA STATES 14K 28K 35K 49K 64K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f417c2f9-fc82-4a54-8a2f-b9e38e3693eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117831399, 'registration': 'RJ72ZBT', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 79396, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/f7009c5f-0304-49fe-bd94-e171b5b3864d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/cbb22978-24b9-4c15-9b7e-d7a2aa020288_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/97c04d19-085e-43ec-a631-0bf72fa76aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/2d4a6e2d-5fb1-4950-9a51-4af4b15c0205_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/ffefc1eb-6a8b-418e-8656-9589af78b246_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/aee92b28-5b79-4e90-936b-aa03f07ecf90_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/b5a7285b-98c0-467d-ac4e-c9bfecbee0fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72ZBT/2025-12-16/image/10f8953a-03c7-4e32-b929-e5891c4f677e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/24-28K 04/25-60K', 'remarks': 'Ex-Private Hire, SPARE KEY, VOSA STATES 14K 28K 35K 49K 64K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f417c2f9-fc82-4a54-8a2f-b9e38e3693eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2ddaeb-030d-5951-9187-941903b0379b with identifier: 117831399
2026-01-28 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2ddaeb-030d-5951-9187-941903b0379b with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c2ddaeb-030d-5951-9187-941903b0379b with scrape type 2
2026-01-28 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2c2ddaeb-030d-5951-9187-941903b0379b, identifier: 117831399
2026-01-28 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4402bfe9-7cec-576e-a88b-4343a0673ed5 with identifier: 118431850
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid+Electric HTTP/1.1" 200 None
2026-01-28 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4402bfe9-7cec-576e-a88b-4343a0673ed5 with identifier: 118431850
2026-01-28 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4402bfe9-7cec-576e-a88b-4343a0673ed5 with identifier: 118431850 to the API
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118431850?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 12,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Hybrid Electric',
'id': '4402bfe9-7cec-576e-a88b-4343a0673ed5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YK25RTU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118431850',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TOYOTA',
'model': 'PRIUS HATCHBACK',
'odometer': 10574,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-07',
'seller_name': 'Regulus Asset Management',
'title': 'TOYOTA PRIUS HATCHBACK 2.0 PHEV Design 5dr CVT',
'transmission': 'automatic',
'trim': '2.0 PHEV Design 5dr CVT',
'vin': None,
'year': 2025}
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118431850%27 HTTP/1.1" 200 None
2026-01-28 19:00:34 [astonbarclay.gb] INFO: Saving data for 118431850: {'auction_closing_time': 1769680800.0, 'created_time': 1768590569.627951, 'last_price_update_time': 1769626834.922337}
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118431850') HTTP/1.1" 204 0
2026-01-28 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a87ffef-4050-52fc-ac81-50f79488084e with identifier: 117864943
2026-01-28 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a87ffef-4050-52fc-ac81-50f79488084e with identifier: 117864943
2026-01-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192539 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
192539
2026-01-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4a87ffef-4050-52fc-ac81-50f79488084e spider: astonbarclay.gb
2026-01-28 19:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4a87ffef-4050-52fc-ac81-50f79488084e due to rule: high_mileage_for_country.json, error: 192539 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
192539
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '4a87ffef-4050-52fc-ac81-50f79488084e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RF72DZN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864943',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 119639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117864943%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Saving data for 117864943: {'auction_closing_time': 1769680800.0, 'created_time': 1767986492.964595, 'last_price_update_time': 1769626835.149858}
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117864943') HTTP/1.1" 204 0
2026-01-28 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2c2ddaeb-030d-5951-9187-941903b0379b with identifier: 117831399
2026-01-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2c2ddaeb-030d-5951-9187-941903b0379b with identifier: 117831399
2026-01-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 79396, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831399', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rj72zbt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '2c2ddaeb-030d-5951-9187-941903b0379b', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 127775} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '2c2ddaeb-030d-5951-9187-941903b0379b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rj72zbt',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831399',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 79396,
'odometer_in_km': 127775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 2c2ddaeb-030d-5951-9187-941903b0379b spider: astonbarclay.gb
2026-01-28 19:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2c2ddaeb-030d-5951-9187-941903b0379b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 79396, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831399', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rj72zbt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '2c2ddaeb-030d-5951-9187-941903b0379b', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 127775} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '2c2ddaeb-030d-5951-9187-941903b0379b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rj72zbt',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831399',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 79396,
'odometer_in_km': 127775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '2c2ddaeb-030d-5951-9187-941903b0379b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ72ZBT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831399',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 79396,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831399%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Saving data for 117831399: {'auction_closing_time': 1769680800.0, 'created_time': 1767986493.300394, 'last_price_update_time': 1769626835.363683}
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117831399') HTTP/1.1" 204 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118955590
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118955590%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118955590: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118739499
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739499%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118739499: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118811715
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811715%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118811715: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118974415
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974415%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118974415: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118649276
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118649276%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118649276: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654382
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654382%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654382: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118532216
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118532216%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118532216: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654441
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654441%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654441: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118989703
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989703%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118989703: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654363
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654363%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654363: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118501749
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118501749%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118501749: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118947354
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118947354%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118947354: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117888562
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117888562%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117888562: 1
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118650161
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118650161%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118650161: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118641866
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118641866%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118641866: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118737678
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118737678%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118737678: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654391
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654391%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654391: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118190110
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118190110%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118190110: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118739367
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118739367%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118739367: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118777010
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118777010%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118777010: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118736488
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118736488%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118736488: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118963908
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118963908%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118963908: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118974643
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974643%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118974643: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118737658
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118737658%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118737658: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654422
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654422%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654422: 1
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118719157
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118719157%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118719157: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654318
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654318%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654318: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654345
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654345%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654345: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 119015865
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119015865%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 119015865: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118940284
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118940284%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118940284: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118992230
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992230%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118992230: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118992572
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992572%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118992572: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118654336
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654336%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118654336: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118811378
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811378%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118811378: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 118636496
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118636496%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 118636496: 0
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117864894
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117864894%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117864894: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117831433
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831433%27 HTTP/1.1" 200 None
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117831433: 2
2026-01-28 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117824863
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117824863%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117824863: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117630402
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117630402%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117630402: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117599446
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599446%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117599446: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117773000
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117773000%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117773000: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118068611
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118068611%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118068611: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117918622
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117918622%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117918622: 2
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118428967?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118441782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117884470?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118457444?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118214401?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118331887?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118622426?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118891424?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117708882
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708882%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117708882: 2
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118147020
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118147020%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118147020: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118538156
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118538156%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118538156: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117831410
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831410%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117831410: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118688744
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118688744%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118688744: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118933388
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118933388%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118933388: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118753404
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118753404%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118753404: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118596066
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118596066%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118596066: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117411447
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411447%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117411447: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 116917185
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116917185%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 116917185: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118000101
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118000101%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118000101: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117716120
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117716120%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117716120: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118387645
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118387645%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118387645: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 118186159
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118186159%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 118186159: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117954040
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117954040%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117954040: 0
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117768126
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768126%27 HTTP/1.1" 200 None
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117768126: 2
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118428967, 'registration': 'YF71ELW', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 41612, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 76, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-09', 'fuel': 'Electric', 'motExpiry': '2026-12-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71ELW/2026-01-08/image/63cdbaaa-56c9-42d6-9f48-5a1d356b710d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/a65e5d18-aaf1-44aa-a1b7-34b7e62d4dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/3ab96c89-a235-47ec-bf3a-024eda19f3d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/b8ed9289-a191-41e5-a473-5058f4021b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/9e69e54c-1e36-458c-810a-8bc61ef9b7d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/50fb4a6b-3dd3-4413-9cf1-f28e8b6697d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/5ab11e9a-c139-427b-8ebc-b6cd519cdb6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/f32bed2c-e52c-4a75-bb2d-8bba9bf78d93_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24-18K', 'remarks': 'VOSA STATES 29K 40K \t Metallic Paint SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/17288c93-ba4f-4a1f-8faf-251b41fa47c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118428967, 'registration': 'YF71ELW', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 41612, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 76, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-09', 'fuel': 'Electric', 'motExpiry': '2026-12-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71ELW/2026-01-08/image/63cdbaaa-56c9-42d6-9f48-5a1d356b710d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/a65e5d18-aaf1-44aa-a1b7-34b7e62d4dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/3ab96c89-a235-47ec-bf3a-024eda19f3d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/b8ed9289-a191-41e5-a473-5058f4021b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/9e69e54c-1e36-458c-810a-8bc61ef9b7d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/50fb4a6b-3dd3-4413-9cf1-f28e8b6697d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/5ab11e9a-c139-427b-8ebc-b6cd519cdb6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71ELW/2026-01-08/image/f32bed2c-e52c-4a75-bb2d-8bba9bf78d93_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24-18K', 'remarks': 'VOSA STATES 29K 40K \t Metallic Paint SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/17288c93-ba4f-4a1f-8faf-251b41fa47c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2fbbd2-eaf7-5edd-a878-b12b3cced743 with identifier: 118428967
2026-01-28 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2fbbd2-eaf7-5edd-a878-b12b3cced743 with scrape type 2
2026-01-28 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb2fbbd2-eaf7-5edd-a878-b12b3cced743 with scrape type 2
2026-01-28 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb2fbbd2-eaf7-5edd-a878-b12b3cced743, identifier: 118428967
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118441782, 'registration': 'YG25DHC', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 17410, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 27, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-25', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 2998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG25DHC/2026-01-09/image/7c8754c9-efa9-4ee0-8fbe-32a961a1c18e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/6de220d1-2324-4bef-9b8a-90f067991f6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/5ac9bc52-4997-4d64-afe5-159be2424aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/52f059b0-e545-4111-9b7d-81736bf34cde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/d22eb1bf-eb0d-4c6f-b8e5-b4918dac359a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/732184fa-7064-4656-b34d-f61dbf2a55ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/cea114f5-eef7-4c12-9c8e-e3f456308509_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/9d64944d-e03c-4c97-b082-6ce055a22117_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/b8684de3-53bf-4fdd-8ddf-9c158c012a49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 20, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9eaedc18-326d-45b7-b963-beb0f53c2edc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118441782, 'registration': 'YG25DHC', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 17410, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 27, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-25', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 2998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG25DHC/2026-01-09/image/7c8754c9-efa9-4ee0-8fbe-32a961a1c18e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/6de220d1-2324-4bef-9b8a-90f067991f6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/5ac9bc52-4997-4d64-afe5-159be2424aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/52f059b0-e545-4111-9b7d-81736bf34cde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/d22eb1bf-eb0d-4c6f-b8e5-b4918dac359a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/732184fa-7064-4656-b34d-f61dbf2a55ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/cea114f5-eef7-4c12-9c8e-e3f456308509_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/9d64944d-e03c-4c97-b082-6ce055a22117_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHC/2026-01-09/image/b8684de3-53bf-4fdd-8ddf-9c158c012a49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 20, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9eaedc18-326d-45b7-b963-beb0f53c2edc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 353641d1-4660-5d14-93ff-c88121a973a5 with identifier: 118441782
2026-01-28 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 353641d1-4660-5d14-93ff-c88121a973a5 with scrape type 2
2026-01-28 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 353641d1-4660-5d14-93ff-c88121a973a5 with scrape type 2
2026-01-28 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 353641d1-4660-5d14-93ff-c88121a973a5, identifier: 118441782
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117884470, 'registration': 'GL72CUX', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 40831, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 64, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-21', 'fuel': 'Electric', 'motExpiry': '2026-12-20', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GL72CUX/2026-01-06/image/f0fb523c-5ced-414d-a5d4-d21a72c1d78e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/04e38953-808b-49b0-82a4-30b1d81cbe5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/885fe26d-9717-43d1-b2b3-a0a647107b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3ccfa207-1289-4179-b2d2-e9dbf33757ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3a7fbff1-6134-407b-bad7-768521f88eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/34103572-35ca-4fc3-b96b-b9a68b158ce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/c6b0ffcd-9792-4fb0-a7ac-d381fdd9a654_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/a90374ff-e4d1-4e37-a17a-dad36aa3af2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3d87ce98-7f3a-4d4e-9cf5-55b37d0e7d8e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/25-29K', 'remarks': 'SPARE KEY Enhanced Autopilot, VOSA STATES 39K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c9d1256a-6995-4441-b0f0-d42c48e1346c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117884470, 'registration': 'GL72CUX', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 40831, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 64, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-21', 'fuel': 'Electric', 'motExpiry': '2026-12-20', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GL72CUX/2026-01-06/image/f0fb523c-5ced-414d-a5d4-d21a72c1d78e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/04e38953-808b-49b0-82a4-30b1d81cbe5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/885fe26d-9717-43d1-b2b3-a0a647107b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3ccfa207-1289-4179-b2d2-e9dbf33757ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3a7fbff1-6134-407b-bad7-768521f88eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/34103572-35ca-4fc3-b96b-b9a68b158ce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/c6b0ffcd-9792-4fb0-a7ac-d381fdd9a654_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/a90374ff-e4d1-4e37-a17a-dad36aa3af2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL72CUX/2026-01-06/image/3d87ce98-7f3a-4d4e-9cf5-55b37d0e7d8e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/25-29K', 'remarks': 'SPARE KEY Enhanced Autopilot, VOSA STATES 39K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c9d1256a-6995-4441-b0f0-d42c48e1346c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eecc83e-a7b1-5381-85f1-233aa235c21a with identifier: 117884470
2026-01-28 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eecc83e-a7b1-5381-85f1-233aa235c21a with scrape type 2
2026-01-28 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eecc83e-a7b1-5381-85f1-233aa235c21a with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5eecc83e-a7b1-5381-85f1-233aa235c21a, identifier: 117884470
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118457444, 'registration': 'YG25DHD', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 18212, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 26, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG25DHD/2026-01-12/image/9992b3e8-dd1a-40de-8f7c-f85fbd347e0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/a6936def-429f-47e7-b3ab-70708a9c0613_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/8f44e856-5c20-467b-9137-bd88849b92a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/4e7e39cb-928e-4652-8e1c-ec73eaae96d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/0c43efad-f856-4331-981c-4bd447cde98c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/a3822410-95cc-4eb9-ac20-098ee2ea5513_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/b7435028-82cc-410f-ab7b-f739e69b9d55_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/6058fdc0-f1c7-4b7c-a3ed-66f4728f137c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital oil + filter change 09/25', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4937967-7e4f-4f06-abe6-1a51baab6680.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118457444, 'registration': 'YG25DHD', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 18212, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 26, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG25DHD/2026-01-12/image/9992b3e8-dd1a-40de-8f7c-f85fbd347e0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/a6936def-429f-47e7-b3ab-70708a9c0613_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/8f44e856-5c20-467b-9137-bd88849b92a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/4e7e39cb-928e-4652-8e1c-ec73eaae96d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/0c43efad-f856-4331-981c-4bd447cde98c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/a3822410-95cc-4eb9-ac20-098ee2ea5513_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/b7435028-82cc-410f-ab7b-f739e69b9d55_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG25DHD/2026-01-12/image/6058fdc0-f1c7-4b7c-a3ed-66f4728f137c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital oil + filter change 09/25', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4937967-7e4f-4f06-abe6-1a51baab6680.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with identifier: 118457444
2026-01-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff, identifier: 118457444
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118214401, 'registration': 'KR72HFL', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 3868, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 62, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-22', 'fuel': 'Electric', 'motExpiry': '2026-12-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR72HFL/2026-01-07/image/2ef84824-9e81-4ff9-91a7-60101f6e4d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/fe0e9d58-545d-498e-83dc-3a3bdd81be95_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/820b30da-3c9a-4609-8af1-80132b31c969_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/c5c9e8a3-6224-4f99-ae49-7f5bcfbd5ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/efe14560-e28a-40af-a7e0-9f99fcc0ccef_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/73134e54-3e83-4895-85bb-a0c8d3cdeb2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/c1e52809-cb11-4809-a1e0-004fa49046f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/1454fc73-4b5d-4532-a8b7-1e2e0b3b2d55_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY Metallic Paint VOSA STATES 3K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8f20779-963e-48fa-b9b7-2806fa0693db.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118214401, 'registration': 'KR72HFL', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 3868, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 62, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-22', 'fuel': 'Electric', 'motExpiry': '2026-12-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR72HFL/2026-01-07/image/2ef84824-9e81-4ff9-91a7-60101f6e4d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/fe0e9d58-545d-498e-83dc-3a3bdd81be95_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/820b30da-3c9a-4609-8af1-80132b31c969_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/c5c9e8a3-6224-4f99-ae49-7f5bcfbd5ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/efe14560-e28a-40af-a7e0-9f99fcc0ccef_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/73134e54-3e83-4895-85bb-a0c8d3cdeb2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/c1e52809-cb11-4809-a1e0-004fa49046f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72HFL/2026-01-07/image/1454fc73-4b5d-4532-a8b7-1e2e0b3b2d55_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY Metallic Paint VOSA STATES 3K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8f20779-963e-48fa-b9b7-2806fa0693db.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5282bb3-5aa5-507e-a300-913cb9ad2fe7 with identifier: 118214401
2026-01-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5282bb3-5aa5-507e-a300-913cb9ad2fe7 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5282bb3-5aa5-507e-a300-913cb9ad2fe7 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a5282bb3-5aa5-507e-a300-913cb9ad2fe7, identifier: 118214401
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118331887, 'registration': 'NV72CNF', 'account': 'ZEN002', 'make': 'LEXUS', 'model': 'NX ESTATE', 'derivative': '450h+ 2.5 5dr E-CVT [Premium Pack]', 'mileage': 21022, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 79, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-28', 'doors': 5, 'engineSize': 2487, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NV72CNF/2026-01-08/image/fe5e674e-2651-428c-855e-fbbf33d9f4ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/a4b24a59-bfb5-4f2c-8d56-362e1e11f13d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/455f0a23-b2f5-4732-8e25-832161d586af_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/0f214270-d442-41ff-abf7-93c91a665b9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/3a024392-4181-4f50-8372-8e8cae31a185_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/58fb9f98-1b3e-40be-80c5-24f39b81d598_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/94df409e-cc50-4519-bdda-d03d68f0c56d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/e399d9d5-4dcb-4d00-ab66-f4fad1e01dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/c8022db4-0b11-4d34-9485-6b3f06ebefbc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24-9K, 02/25-16K,', 'remarks': 'SPARE KEY, VOSA STATES 20K, Mm21 Lexus Link Pro-14in Hd Tuchscren', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 22, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a89d4b0-6372-4bb3-a2ca-291ffadc0ff0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118331887, 'registration': 'NV72CNF', 'account': 'ZEN002', 'make': 'LEXUS', 'model': 'NX ESTATE', 'derivative': '450h+ 2.5 5dr E-CVT [Premium Pack]', 'mileage': 21022, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 79, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-28', 'doors': 5, 'engineSize': 2487, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NV72CNF/2026-01-08/image/fe5e674e-2651-428c-855e-fbbf33d9f4ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/a4b24a59-bfb5-4f2c-8d56-362e1e11f13d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/455f0a23-b2f5-4732-8e25-832161d586af_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/0f214270-d442-41ff-abf7-93c91a665b9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/3a024392-4181-4f50-8372-8e8cae31a185_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/58fb9f98-1b3e-40be-80c5-24f39b81d598_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/94df409e-cc50-4519-bdda-d03d68f0c56d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/e399d9d5-4dcb-4d00-ab66-f4fad1e01dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV72CNF/2026-01-08/image/c8022db4-0b11-4d34-9485-6b3f06ebefbc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24-9K, 02/25-16K,', 'remarks': 'SPARE KEY, VOSA STATES 20K, Mm21 Lexus Link Pro-14in Hd Tuchscren', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 22, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a89d4b0-6372-4bb3-a2ca-291ffadc0ff0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with identifier: 118331887
2026-01-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a25b9a0c-4783-5da2-ac6a-5d77859b72a2, identifier: 118331887
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118622426, 'registration': 'SV67TJZ', 'account': 'MPH002', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 73285, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 84, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/e86edfed-0325-4073-a113-3e28bc51f7a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/d187107b-e682-4612-a72c-e255823d5be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/bb980e52-0a36-43cc-ab61-3bb87531842f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/64c47602-45e7-4fd6-aa8e-bf84f114f021_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/f496644a-6339-465a-acff-e4a68e942073_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/b3745ecb-2c23-479b-aebc-2cbc72860d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/ced4d34d-3c82-4a30-a0be-463f983b5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/be9adba8-9fd2-43e2-b0b7-82fae7fe2f16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/bd14afd8-f7f5-4253-bdcc-ea38ea311443_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/1ca100b1-73e0-48da-8b0e-d12bd5f6a36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/ada4da77-699e-44a9-ad7a-29b72c2202bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/d64aafc3-b561-4530-8e0e-7a9dd5bcbf56_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/1005bb84-0616-4485-961e-ad82cfd46018_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 40k, 54k, 72k, 73k', 'virtual': False, 'seller': 'Fort Used Car Centre', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6adc6a5-19e9-4e93-a167-373339a2f589.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118622426, 'registration': 'SV67TJZ', 'account': 'MPH002', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 73285, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 84, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/e86edfed-0325-4073-a113-3e28bc51f7a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/d187107b-e682-4612-a72c-e255823d5be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/bb980e52-0a36-43cc-ab61-3bb87531842f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/64c47602-45e7-4fd6-aa8e-bf84f114f021_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/f496644a-6339-465a-acff-e4a68e942073_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/b3745ecb-2c23-479b-aebc-2cbc72860d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/ced4d34d-3c82-4a30-a0be-463f983b5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/be9adba8-9fd2-43e2-b0b7-82fae7fe2f16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/bd14afd8-f7f5-4253-bdcc-ea38ea311443_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/1ca100b1-73e0-48da-8b0e-d12bd5f6a36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/ada4da77-699e-44a9-ad7a-29b72c2202bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/d64aafc3-b561-4530-8e0e-7a9dd5bcbf56_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV67TJZ/2026-01-14/image/1005bb84-0616-4485-961e-ad82cfd46018_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 40k, 54k, 72k, 73k', 'virtual': False, 'seller': 'Fort Used Car Centre', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6adc6a5-19e9-4e93-a167-373339a2f589.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fef42b5-ba70-5b15-bf58-6f7170570d07 with identifier: 118622426
2026-01-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fef42b5-ba70-5b15-bf58-6f7170570d07 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fef42b5-ba70-5b15-bf58-6f7170570d07 with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2fef42b5-ba70-5b15-bf58-6f7170570d07, identifier: 118622426
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118891424, 'registration': 'CP17VGO', 'account': 'ART001', 'make': 'PEUGEOT', 'model': '308 HATCHBACK', 'derivative': '1.2 PureTech 130 Allure 5dr', 'mileage': 87977, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 40, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-08-21', 'fuel': 'Petrol', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP17VGO/2026-01-26/image/011b314e-678e-48ed-b25e-558ced492c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/042b2c62-09b7-4614-a983-4359da3ab051_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/422c98c2-5fe5-43a8-9d0e-446e3975c857_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/bc16f132-b22e-406d-93a1-5cc9194bee66_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/44eda2fd-fa76-4f93-b2b3-4e3a8d08967b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/2a433658-2e52-4f8f-8b26-b439fb1c09fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/75211577-1825-49ab-b7c4-9fad92cadc48_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/c5dd463f-524e-4ff1-a3b1-b3e71978a1a6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-13K, 07/19-24K, 08/20-34K, 06/21-43K, 06/22-53K, 06/23-64K, 07/24-72K, 07/25-83K', 'remarks': 'vosa@ 34k, 43k, 53k, 64k, 72k, 83k SPARE KEY IN OFFICE - NEW ENGINE @ 26K (17.10.2019)', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14778f50-fbf9-4b7a-8fe4-f21595836395.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118891424, 'registration': 'CP17VGO', 'account': 'ART001', 'make': 'PEUGEOT', 'model': '308 HATCHBACK', 'derivative': '1.2 PureTech 130 Allure 5dr', 'mileage': 87977, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 40, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-08-21', 'fuel': 'Petrol', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP17VGO/2026-01-26/image/011b314e-678e-48ed-b25e-558ced492c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/042b2c62-09b7-4614-a983-4359da3ab051_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/422c98c2-5fe5-43a8-9d0e-446e3975c857_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/bc16f132-b22e-406d-93a1-5cc9194bee66_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/44eda2fd-fa76-4f93-b2b3-4e3a8d08967b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/2a433658-2e52-4f8f-8b26-b439fb1c09fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/75211577-1825-49ab-b7c4-9fad92cadc48_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP17VGO/2026-01-26/image/c5dd463f-524e-4ff1-a3b1-b3e71978a1a6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-13K, 07/19-24K, 08/20-34K, 06/21-43K, 06/22-53K, 06/23-64K, 07/24-72K, 07/25-83K', 'remarks': 'vosa@ 34k, 43k, 53k, 64k, 72k, 83k SPARE KEY IN OFFICE - NEW ENGINE @ 26K (17.10.2019)', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14778f50-fbf9-4b7a-8fe4-f21595836395.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c766c45-af17-5e60-93dc-aa2f2558e9cc with identifier: 118891424
2026-01-28 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c766c45-af17-5e60-93dc-aa2f2558e9cc with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c766c45-af17-5e60-93dc-aa2f2558e9cc with scrape type 2
2026-01-28 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6c766c45-af17-5e60-93dc-aa2f2558e9cc, identifier: 118891424
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118804414
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118804414%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118804414: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118363179
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118363179%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118363179: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118317293
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118317293%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118317293: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118953037
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953037%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118953037: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118554810
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118554810%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118554810: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118609116
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118609116%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118609116: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118223032
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118223032%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118223032: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118336084
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118336084%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118336084: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118391386
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118391386%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 118391386: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117778077
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117778077%27 HTTP/1.1" 200 None
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117778077: 0
2026-01-28 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 118345620
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345620%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118345620: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118455745
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118455745%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118455745: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118474022
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118474022%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118474022: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118802158
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118802158%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118802158: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118454482
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118454482%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118454482: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118214520
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118214520%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118214520: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118391248
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118391248%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118391248: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118340177
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118340177%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118340177: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118651460
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118651460%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118651460: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118319223
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118319223%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118319223: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118387949
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118387949%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118387949: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118214846
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118214846%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118214846: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118660628
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118660628%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118660628: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118514686
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118514686%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118514686: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118624285
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118624285%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118624285: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118900106
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118900106%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118900106: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117125475
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117125475%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117125475: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118687745
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118687745%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118687745: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118499464
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118499464%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118499464: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118137285
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137285%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118137285: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118468294
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118468294%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118468294: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118672353
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118672353%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118672353: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118750338
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118750338%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118750338: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118533677
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533677%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118533677: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117755922
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117755922%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117755922: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118130313
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118130313%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118130313: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118516328
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118516328%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118516328: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118572715
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118572715%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118572715: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118136850
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118136850%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118136850: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118696553
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118696553%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118696553: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118610962
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118610962%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118610962: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118534560
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534560%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118534560: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118665015
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118665015%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118665015: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118335381
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118335381%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118335381: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118534350
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534350%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118534350: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118533666
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533666%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118533666: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117429733
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429733%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117429733: 0
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 118245988
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118245988%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Scrape type for 118245988: 2
2026-01-28 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb2fbbd2-eaf7-5edd-a878-b12b3cced743 with identifier: 118428967
2026-01-28 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb2fbbd2-eaf7-5edd-a878-b12b3cced743 with identifier: 118428967
2026-01-28 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41612, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118428967', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'yf71elw', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'cb2fbbd2-eaf7-5edd-a878-b12b3cced743', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 66967} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 49,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'cb2fbbd2-eaf7-5edd-a878-b12b3cced743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yf71elw',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118428967',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'audi',
'make_model': 'audi q4 e-tron estate',
'model': 'q4 e-tron estate',
'odometer': 41612,
'odometer_in_km': 66967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'sanitized_make': 'audi',
'seller_name': 'zenith',
'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
'transmission': 'automatic',
'trim': '150kw 40 82kwh s line 5dr auto',
'vin': None,
'year': 2021}
2026-01-28 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: cb2fbbd2-eaf7-5edd-a878-b12b3cced743 spider: astonbarclay.gb
2026-01-28 19:00:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: cb2fbbd2-eaf7-5edd-a878-b12b3cced743 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41612, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118428967', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'yf71elw', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'cb2fbbd2-eaf7-5edd-a878-b12b3cced743', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 66967} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 49,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'cb2fbbd2-eaf7-5edd-a878-b12b3cced743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yf71elw',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118428967',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'audi',
'make_model': 'audi q4 e-tron estate',
'model': 'q4 e-tron estate',
'odometer': 41612,
'odometer_in_km': 66967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'sanitized_make': 'audi',
'seller_name': 'zenith',
'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
'transmission': 'automatic',
'trim': '150kw 40 82kwh s line 5dr auto',
'vin': None,
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'cb2fbbd2-eaf7-5edd-a878-b12b3cced743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YF71ELW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118428967',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'AUDI',
'model': 'Q4 E-TRON ESTATE',
'odometer': 41612,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'seller_name': 'Zenith',
'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto',
'transmission': 'automatic',
'trim': '150kW 40 82kWh S Line 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118428967%27 HTTP/1.1" 200 None
2026-01-28 19:00:38 [astonbarclay.gb] INFO: Saving data for 118428967: {'auction_closing_time': 1769680800.0, 'created_time': 1768936661.592837, 'last_price_update_time': 1769626838.990491}
2026-01-28 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118428967') HTTP/1.1" 204 0
2026-01-28 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 353641d1-4660-5d14-93ff-c88121a973a5 with identifier: 118441782
2026-01-28 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 353641d1-4660-5d14-93ff-c88121a973a5 with identifier: 118441782
2026-01-28 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 353641d1-4660-5d14-93ff-c88121a973a5 with identifier: 118441782 to the API
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27353641d1-4660-5d14-93ff-c88121a973a5%27 HTTP/1.1" 200 None
2026-01-28 19:00:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 353641d1-4660-5d14-93ff-c88121a973a5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118441782?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 20,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Hybrid Electric',
'id': '353641d1-4660-5d14-93ff-c88121a973a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YG25DHC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118441782',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TOYOTA',
'model': 'PRIUS HATCHBACK',
'odometer': 17410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-25',
'seller_name': 'Regulus Asset Management',
'title': 'TOYOTA PRIUS HATCHBACK 2.0 PHEV Design 5dr CVT',
'transmission': 'automatic',
'trim': '2.0 PHEV Design 5dr CVT',
'vin': None,
'year': 2025}
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118441782%27 HTTP/1.1" 200 None
2026-01-28 19:00:39 [astonbarclay.gb] INFO: Saving data for 118441782: {'auction_closing_time': 1769680800.0, 'created_time': 1767986547.506038, 'last_price_update_time': 1769626839.449697}
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118441782') HTTP/1.1" 204 0
2026-01-28 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5eecc83e-a7b1-5381-85f1-233aa235c21a with identifier: 117884470
2026-01-28 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5eecc83e-a7b1-5381-85f1-233aa235c21a with identifier: 117884470
2026-01-28 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5eecc83e-a7b1-5381-85f1-233aa235c21a with identifier: 117884470 to the API
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117884470?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '5eecc83e-a7b1-5381-85f1-233aa235c21a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GL72CUX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117884470',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TESLA',
'model': 'MODEL 3 SALOON',
'odometer': 40831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-21',
'seller_name': 'Zenith',
'title': 'TESLA MODEL 3 SALOON RWD 4dr Auto',
'transmission': 'automatic',
'trim': 'RWD 4dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117884470%27 HTTP/1.1" 200 None
2026-01-28 19:00:39 [astonbarclay.gb] INFO: Saving data for 117884470: {'auction_closing_time': 1769680800.0, 'created_time': 1768331986.864079, 'last_price_update_time': 1769626839.856287}
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117884470') HTTP/1.1" 204 0
2026-01-28 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with identifier: 118457444
2026-01-28 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with identifier: 118457444
2026-01-28 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff with identifier: 118457444 to the API
2026-01-28 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272cc73b30-29e1-5458-aa72-d18c9dc0f8ff%27 HTTP/1.1" 200 None
2026-01-28 19:00:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2cc73b30-29e1-5458-aa72-d18c9dc0f8ff: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118457444?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 12,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '2cc73b30-29e1-5458-aa72-d18c9dc0f8ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YG25DHD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118457444',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TOYOTA',
'model': 'PRIUS HATCHBACK',
'odometer': 18212,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-25',
'seller_name': 'Regulus Asset Management',
'title': 'TOYOTA PRIUS HATCHBACK 2.0 PHEV Design 5dr CVT',
'transmission': 'automatic',
'trim': '2.0 PHEV Design 5dr CVT',
'vin': None,
'year': 2025}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118457444%27 HTTP/1.1" 200 None
2026-01-28 19:00:40 [astonbarclay.gb] INFO: Saving data for 118457444: {'auction_closing_time': 1769680800.0, 'created_time': 1767986543.168613, 'last_price_update_time': 1769626840.139461}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118457444') HTTP/1.1" 204 0
2026-01-28 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a5282bb3-5aa5-507e-a300-913cb9ad2fe7 with identifier: 118214401
2026-01-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a5282bb3-5aa5-507e-a300-913cb9ad2fe7 with identifier: 118214401
2026-01-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3868, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118214401', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'kr72hfl', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a5282bb3-5aa5-507e-a300-913cb9ad2fe7', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 6224} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'a5282bb3-5aa5-507e-a300-913cb9ad2fe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'kr72hfl',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118214401',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'cupra',
'make_model': 'cupra born electric hatchback',
'model': 'born electric hatchback',
'odometer': 3868,
'odometer_in_km': 6224,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'sanitized_make': 'cupra',
'seller_name': 'zenith',
'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
'transmission': 'automatic',
'trim': '150kw v2 58kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a5282bb3-5aa5-507e-a300-913cb9ad2fe7 spider: astonbarclay.gb
2026-01-28 19:00:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a5282bb3-5aa5-507e-a300-913cb9ad2fe7 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3868, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118214401', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'kr72hfl', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a5282bb3-5aa5-507e-a300-913cb9ad2fe7', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 6224} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'a5282bb3-5aa5-507e-a300-913cb9ad2fe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'kr72hfl',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118214401',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'cupra',
'make_model': 'cupra born electric hatchback',
'model': 'born electric hatchback',
'odometer': 3868,
'odometer_in_km': 6224,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'sanitized_make': 'cupra',
'seller_name': 'zenith',
'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
'transmission': 'automatic',
'trim': '150kw v2 58kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'a5282bb3-5aa5-507e-a300-913cb9ad2fe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'KR72HFL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118214401',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'CUPRA',
'model': 'BORN ELECTRIC HATCHBACK',
'odometer': 3868,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seller_name': 'Zenith',
'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V2 58kWh 5dr Auto',
'transmission': 'automatic',
'trim': '150kW V2 58kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118214401%27 HTTP/1.1" 200 None
2026-01-28 19:00:40 [astonbarclay.gb] INFO: Saving data for 118214401: {'auction_closing_time': 1769680800.0, 'created_time': 1768935878.570308, 'last_price_update_time': 1769626840.355777}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118214401') HTTP/1.1" 204 0
2026-01-28 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with identifier: 118331887
2026-01-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with identifier: 118331887
2026-01-28 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a25b9a0c-4783-5da2-ac6a-5d77859b72a2 with identifier: 118331887 to the API
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118331887?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 22,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': 'a25b9a0c-4783-5da2-ac6a-5d77859b72a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'NV72CNF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118331887',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'LEXUS',
'model': 'NX ESTATE',
'odometer': 21022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seller_name': 'Zenith',
'title': 'LEXUS NX ESTATE 450h+ 2.5 5dr E-CVT [Premium Pack]',
'transmission': 'automatic',
'trim': '450h+ 2.5 5dr E-CVT [Premium Pack]',
'vin': None,
'year': 2022}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118331887%27 HTTP/1.1" 200 None
2026-01-28 19:00:40 [astonbarclay.gb] INFO: Saving data for 118331887: {'auction_closing_time': 1769680800.0, 'created_time': 1768936766.648891, 'last_price_update_time': 1769626840.692163}
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118331887') HTTP/1.1" 204 0
2026-01-28 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2fef42b5-ba70-5b15-bf58-6f7170570d07 with identifier: 118622426
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2026-01-28 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2fef42b5-ba70-5b15-bf58-6f7170570d07 with identifier: 118622426
2026-01-28 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2fef42b5-ba70-5b15-bf58-6f7170570d07 with identifier: 118622426 to the API
2026-01-28 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118622426?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BRONZE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2fef42b5-ba70-5b15-bf58-6f7170570d07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SV67TJZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118622426',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': '3008 ESTATE',
'odometer': 73285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seller_name': 'Fort Used Car Centre',
'title': 'PEUGEOT 3008 ESTATE 1.2 PureTech Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Allure 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118622426%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Saving data for 118622426: {'auction_closing_time': 1769680800.0, 'created_time': 1768417743.278021, 'last_price_update_time': 1769626841.196591}
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118622426') HTTP/1.1" 204 0
2026-01-28 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6c766c45-af17-5e60-93dc-aa2f2558e9cc with identifier: 118891424
2026-01-28 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6c766c45-af17-5e60-93dc-aa2f2558e9cc with identifier: 118891424
2026-01-28 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141584 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141584
2026-01-28 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6c766c45-af17-5e60-93dc-aa2f2558e9cc spider: astonbarclay.gb
2026-01-28 19:00:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6c766c45-af17-5e60-93dc-aa2f2558e9cc due to rule: high_mileage_for_make.json, error: 141584 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141584
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c766c45-af17-5e60-93dc-aa2f2558e9cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'CP17VGO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118891424',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': '308 HATCHBACK',
'odometer': 87977,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-21',
'seller_name': 'Arthurs Motor Group',
'title': 'PEUGEOT 308 HATCHBACK 1.2 PureTech 130 Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 Allure 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118891424%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Saving data for 118891424: {'auction_closing_time': 1769680800.0, 'created_time': 1769194887.482509, 'last_price_update_time': 1769626841.549339}
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118891424') HTTP/1.1" 204 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118041742
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118041742%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118041742: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117741042
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741042%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117741042: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118345816
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345816%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118345816: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118335572
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118335572%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118335572: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118072322
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118072322%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118072322: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118755434
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118755434%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118755434: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117427680
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427680%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117427680: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118296025
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118296025%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118296025: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118158100
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118158100%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118158100: 2
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118534802
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534802%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118534802: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118407590
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118407590%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118407590: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118846094
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118846094%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118846094: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117103480
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103480%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117103480: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118522657
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118522657%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118522657: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118276826
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118276826%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118276826: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118742581
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118742581%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118742581: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118319676
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118319676%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118319676: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118310640
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118310640%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118310640: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118362409
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118362409%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118362409: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118147902
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118147902%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118147902: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118533437
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533437%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118533437: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118592558
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118592558%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118592558: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118071779
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118071779%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118071779: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118720017
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720017%27 HTTP/1.1" 200 None
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Scrape type for 118720017: 0
2026-01-28 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 118473981
2026-01-28 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118473981%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118473981: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118429483
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118429483%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118429483: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118682632
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118682632%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118682632: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118071291
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118071291%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118071291: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118159491
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118159491%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118159491: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118440812
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118440812%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118440812: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118564092
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118564092%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118564092: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118345806
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345806%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118345806: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118666995
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118666995%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118666995: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118345828
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345828%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118345828: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118347430
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118347430%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118347430: 2
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118534585
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118534585%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118534585: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118563672
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118563672%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118563672: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118223362
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118223362%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118223362: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118137072
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137072%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118137072: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118158243
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118158243%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118158243: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118137466
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137466%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118137466: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118533741
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533741%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118533741: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118779825
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118779825%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118779825: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118491188
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118491188%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118491188: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118719952
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118719952%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118719952: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118533616
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533616%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118533616: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118362271
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118362271%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118362271: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118744147
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118744147%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118744147: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117742671
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117742671%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117742671: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118603313
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118603313%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118603313: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118071279
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118071279%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118071279: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118609864
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118609864%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118609864: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118813488
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118813488%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118813488: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118689701
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118689701%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118689701: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118148070
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118148070%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118148070: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118754584
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118754584%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118754584: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118367134
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118367134%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118367134: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118292502
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118292502%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118292502: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118738982
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118738982%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118738982: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118139339
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118139339%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118139339: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118459762
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118459762%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118459762: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118458275
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118458275%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118458275: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118813478
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118813478%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118813478: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118775836
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775836%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118775836: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118821608
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118821608%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118821608: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118911076
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118911076%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118911076: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118659452
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118659452%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118659452: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118955846
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118955846%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118955846: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 118904010
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118904010%27 HTTP/1.1" 200 None
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Scrape type for 118904010: 0
2026-01-28 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 116382239
2026-01-28 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116382239%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 116382239: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118533326
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533326%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118533326: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118421046
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118421046%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118421046: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118930113
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118930113%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118930113: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117206199
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117206199%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117206199: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118745420
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118745420%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118745420: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117934287
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117934287%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117934287: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118319412
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118319412%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118319412: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118459372
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118459372%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118459372: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118745579
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118745579%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118745579: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118874996
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118874996%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118874996: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118207662
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118207662%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118207662: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118695668
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118695668%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118695668: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118821625
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118821625%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118821625: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118810364
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118810364%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118810364: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117988799
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117988799%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117988799: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118714230
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118714230%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118714230: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118381159
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118381159%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118381159: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118683189
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118683189%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118683189: 2
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118958829
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118958829%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118958829: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118926859
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118926859%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118926859: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118978437
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118978437%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118978437: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118962003
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118962003%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118962003: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118950918
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950918%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118950918: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118955790
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118955790%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118955790: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 119099541
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099541%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 119099541: 1
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118222274?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118934734?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118939194?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118953718?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118973565?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118790658?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118980604
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118980604%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118980604: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118600422
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118600422%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118600422: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 119038924
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119038924%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 119038924: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118920797
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118920797%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118920797: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 119016298
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119016298%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 119016298: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118982362
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118982362%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118982362: 0
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 119055092
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119055092%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 119055092: 1
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 118651836
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118651836%27 HTTP/1.1" 200 None
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Scrape type for 118651836: 2
2026-01-28 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118119437?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118222274, 'registration': 'AJ22KOU', 'account': 'ZEN009', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 81022, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Electric', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/83e8169a-8e97-41d3-84c0-5f79f1a994ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/cfe6b91a-7e70-443f-a9a6-3d8cb82cc8d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/cc192bbd-22f7-457b-89be-098e9dbf8e38_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/43075a30-a0bd-417b-9713-788fd3272260_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/ef450c95-1636-4088-86f6-37f297e18937_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/7dd8c4ab-d099-4bc3-8111-431bc7ac9599_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/3da24b18-18f5-4cc8-a1eb-eb416f7e770f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/36fa99d9-ed82-4659-9930-127a2781a014_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 73K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba558d7c-2321-4005-8b86-6f57ffe2ee63.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118222274, 'registration': 'AJ22KOU', 'account': 'ZEN009', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 81022, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Electric', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/83e8169a-8e97-41d3-84c0-5f79f1a994ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/cfe6b91a-7e70-443f-a9a6-3d8cb82cc8d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/cc192bbd-22f7-457b-89be-098e9dbf8e38_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/43075a30-a0bd-417b-9713-788fd3272260_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/ef450c95-1636-4088-86f6-37f297e18937_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/7dd8c4ab-d099-4bc3-8111-431bc7ac9599_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/3da24b18-18f5-4cc8-a1eb-eb416f7e770f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KOU/2026-01-21/image/36fa99d9-ed82-4659-9930-127a2781a014_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 73K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba558d7c-2321-4005-8b86-6f57ffe2ee63.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3173504c-5b31-5921-8f6a-d0f049f2379f with identifier: 118222274
2026-01-28 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3173504c-5b31-5921-8f6a-d0f049f2379f with scrape type 2
2026-01-28 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3173504c-5b31-5921-8f6a-d0f049f2379f with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3173504c-5b31-5921-8f6a-d0f049f2379f, identifier: 118222274
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118934734, 'registration': 'KM17UFZ', 'account': 'MPH002', 'make': 'CITROEN', 'model': 'GRAND C4 PICASSO ESTATE', 'derivative': '1.2 PureTech Feel 5dr', 'mileage': 112212, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 86, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/2993f642-7b74-414d-9b5a-f8bcdf5b1b6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/2a6a58bf-6bdd-46c6-8798-1b8ad635581a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/21978187-e963-433d-a887-31b9c5c5ac6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/b75de35c-0faa-4032-8144-48bc928600b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/fe8f4750-3aad-42c3-8037-8173bba39920_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/883116bc-11ea-4525-b747-86d87107d710_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/6fa9ef9b-d1bd-45af-ac1b-7ec6c855c34a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/d4372047-f274-437f-bc53-998c8a7e7287_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/260bf59f-93a8-4009-a8f1-eda394b4f3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/0cff6d13-2344-471f-9470-5a6ac99a0cf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/138ad5d6-5560-49d0-be0d-8e57891c4933_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/73a5c222-da05-4339-81c6-dfd285585d7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/3eb2ae09-ce5d-42d1-b5dd-c2630816cb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/84b4ce69-4890-4b7d-ad97-67d7a0c99afc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/6cda5488-c374-4e9a-bfbb-658b5a5d4e2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/578276c0-a5de-4aa5-ac33-eb95f920718b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/a7011df1-365a-4a84-b161-b8e978c1f6bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/393b5cb6-3f19-4e0d-93e3-47497c2038b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/d2f3da43-015a-4251-8e7a-c1fbb56537ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/306bae32-3922-4859-8965-e7061b63096d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 33k, 43k, 63k, 79k, 95k, 111k spare key', 'virtual': False, 'seller': 'Fort Used Car Centre', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cddbc67c-8db3-471b-b91c-fb41d1b087e6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118934734, 'registration': 'KM17UFZ', 'account': 'MPH002', 'make': 'CITROEN', 'model': 'GRAND C4 PICASSO ESTATE', 'derivative': '1.2 PureTech Feel 5dr', 'mileage': 112212, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 86, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/2993f642-7b74-414d-9b5a-f8bcdf5b1b6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/2a6a58bf-6bdd-46c6-8798-1b8ad635581a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/21978187-e963-433d-a887-31b9c5c5ac6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/b75de35c-0faa-4032-8144-48bc928600b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/fe8f4750-3aad-42c3-8037-8173bba39920_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/883116bc-11ea-4525-b747-86d87107d710_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/6fa9ef9b-d1bd-45af-ac1b-7ec6c855c34a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/d4372047-f274-437f-bc53-998c8a7e7287_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/260bf59f-93a8-4009-a8f1-eda394b4f3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/0cff6d13-2344-471f-9470-5a6ac99a0cf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/138ad5d6-5560-49d0-be0d-8e57891c4933_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/73a5c222-da05-4339-81c6-dfd285585d7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/3eb2ae09-ce5d-42d1-b5dd-c2630816cb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/84b4ce69-4890-4b7d-ad97-67d7a0c99afc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/6cda5488-c374-4e9a-bfbb-658b5a5d4e2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/578276c0-a5de-4aa5-ac33-eb95f920718b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/a7011df1-365a-4a84-b161-b8e978c1f6bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/393b5cb6-3f19-4e0d-93e3-47497c2038b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/d2f3da43-015a-4251-8e7a-c1fbb56537ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM17UFZ/2026-01-23/image/306bae32-3922-4859-8965-e7061b63096d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 33k, 43k, 63k, 79k, 95k, 111k spare key', 'virtual': False, 'seller': 'Fort Used Car Centre', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cddbc67c-8db3-471b-b91c-fb41d1b087e6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c0a62f-58bc-59e4-a59c-fc20ed265a71 with identifier: 118934734
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c0a62f-58bc-59e4-a59c-fc20ed265a71 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c0a62f-58bc-59e4-a59c-fc20ed265a71 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2c0a62f-58bc-59e4-a59c-fc20ed265a71, identifier: 118934734
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118939194, 'registration': 'RV17AKG', 'account': 'RIV012', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.6 EcoBoost ST-2 5dr', 'mileage': 65425, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 130, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV17AKG/2026-01-23/image/11a7d99e-93e9-42d7-af3f-18688a0cb827_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/04cec9dc-498b-4439-9b44-9c119a973e83_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/ba5b5756-42c2-4000-8c2f-3326ebaa38ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/f7297a7c-4d42-4865-a134-c7a299b9ce1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/63fcc36f-6ef4-4858-b602-e48eb5bdb6b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/df5137e3-e9aa-4aa2-a32c-01abeb5f4818_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/e6af48f1-f6e9-4d9e-a6c7-36f0fe0efd98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/90a45fa7-72b7-4b68-8de3-52144a0211e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/84baac47-0f79-40e6-9028-85c3b3b89aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/4698099b-43b6-405a-a8ed-8be28b710288_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2386c3e5-97a6-4df2-8a7b-01cdfdfb16cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/5cf3cf63-541d-4d84-9878-538c45e9a570_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/66325594-98b2-4df1-ae0c-4dc956a160f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/49bbc032-09ae-4406-badf-9be52bc39ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/48cb7ea3-5359-4a25-a007-d3d3672efe49_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/4e3e2a98-dd5b-4b2f-88f1-b32929f01f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2698f9f1-9d3a-4a2c-9df6-27acdac90b00_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/ff74108e-66e2-49d1-a615-df17a6d2ae61_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/b070cf04-246a-4a35-83d6-a9bd476a55c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/3c24938f-2cb4-4583-a12f-e857d65917c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/1b0d6e6c-1e92-4c8d-81d8-294562747746_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/a64c30b7-e0eb-490e-8ae8-7591f30b18f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2110647c-10a4-4b90-b397-e54a283a093a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '03/18- 4k, 03/20- 25k, 03/21- 30k, 09/22- 50k, 12/24- 59k', 'remarks': 'vosa@ 24k, 30k, 45k, 52k, 56k, 61k GHOST IMBOLISER FITTED- instructions are in the docs / SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd453e67-258e-4135-a611-ffa6345c6667.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118939194, 'registration': 'RV17AKG', 'account': 'RIV012', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.6 EcoBoost ST-2 5dr', 'mileage': 65425, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 130, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV17AKG/2026-01-23/image/11a7d99e-93e9-42d7-af3f-18688a0cb827_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/04cec9dc-498b-4439-9b44-9c119a973e83_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/ba5b5756-42c2-4000-8c2f-3326ebaa38ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/f7297a7c-4d42-4865-a134-c7a299b9ce1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/63fcc36f-6ef4-4858-b602-e48eb5bdb6b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/df5137e3-e9aa-4aa2-a32c-01abeb5f4818_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/e6af48f1-f6e9-4d9e-a6c7-36f0fe0efd98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/90a45fa7-72b7-4b68-8de3-52144a0211e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/84baac47-0f79-40e6-9028-85c3b3b89aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/4698099b-43b6-405a-a8ed-8be28b710288_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2386c3e5-97a6-4df2-8a7b-01cdfdfb16cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/5cf3cf63-541d-4d84-9878-538c45e9a570_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/66325594-98b2-4df1-ae0c-4dc956a160f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/49bbc032-09ae-4406-badf-9be52bc39ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/48cb7ea3-5359-4a25-a007-d3d3672efe49_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/4e3e2a98-dd5b-4b2f-88f1-b32929f01f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2698f9f1-9d3a-4a2c-9df6-27acdac90b00_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/ff74108e-66e2-49d1-a615-df17a6d2ae61_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/b070cf04-246a-4a35-83d6-a9bd476a55c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/3c24938f-2cb4-4583-a12f-e857d65917c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/1b0d6e6c-1e92-4c8d-81d8-294562747746_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/a64c30b7-e0eb-490e-8ae8-7591f30b18f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV17AKG/2026-01-23/image/2110647c-10a4-4b90-b397-e54a283a093a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '03/18- 4k, 03/20- 25k, 03/21- 30k, 09/22- 50k, 12/24- 59k', 'remarks': 'vosa@ 24k, 30k, 45k, 52k, 56k, 61k GHOST IMBOLISER FITTED- instructions are in the docs / SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd453e67-258e-4135-a611-ffa6345c6667.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113aaed7-6ed9-5793-9283-93b173a686f4 with identifier: 118939194
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113aaed7-6ed9-5793-9283-93b173a686f4 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113aaed7-6ed9-5793-9283-93b173a686f4 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 113aaed7-6ed9-5793-9283-93b173a686f4, identifier: 118939194
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118953718, 'registration': 'VO17PNL', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'MAZDA6 DIESEL TOURER', 'derivative': '2.2d [175] Sport Nav 5dr Auto', 'mileage': 120041, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 306, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-03-07', 'fuel': 'Diesel', 'motExpiry': '2026-06-15', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO17PNL/2026-01-27/image/2d06de27-53d8-4a4a-898e-a658ee5b3d8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/bc9770d4-7d8e-4990-b9f2-653f39329479_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/4f03e690-e402-4439-a77d-867937f07363_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/b96ee29d-caf9-4a14-8d48-8aafbbf841d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/a00db4ed-c3ba-4891-9795-aeedd1990ba8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/17ebedfd-56d5-4e28-beb5-d6b66bc1b760_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/135f80b8-6f9f-4826-aa9a-6a4bc4ed3d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/01b68bbe-2605-47a0-9517-dbcf72b34953_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/b968fb48-1dce-4514-8e08-1219453e7339_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**567** VOSA STATES 61K, 66K, 76K, 90K, 103K, 115K, 115K, SD CARD, SPARE KEY', 'virtual': True, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f2b03e2c-5a71-40ce-a58d-2ff72dd88c84.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118953718, 'registration': 'VO17PNL', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'MAZDA6 DIESEL TOURER', 'derivative': '2.2d [175] Sport Nav 5dr Auto', 'mileage': 120041, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 306, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-03-07', 'fuel': 'Diesel', 'motExpiry': '2026-06-15', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO17PNL/2026-01-27/image/2d06de27-53d8-4a4a-898e-a658ee5b3d8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/bc9770d4-7d8e-4990-b9f2-653f39329479_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/4f03e690-e402-4439-a77d-867937f07363_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/b96ee29d-caf9-4a14-8d48-8aafbbf841d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/a00db4ed-c3ba-4891-9795-aeedd1990ba8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/17ebedfd-56d5-4e28-beb5-d6b66bc1b760_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/135f80b8-6f9f-4826-aa9a-6a4bc4ed3d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/01b68bbe-2605-47a0-9517-dbcf72b34953_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO17PNL/2026-01-27/image/b968fb48-1dce-4514-8e08-1219453e7339_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**567** VOSA STATES 61K, 66K, 76K, 90K, 103K, 115K, 115K, SD CARD, SPARE KEY', 'virtual': True, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f2b03e2c-5a71-40ce-a58d-2ff72dd88c84.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d86c9c-df66-5f66-b963-a159b6540ba1 with identifier: 118953718
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d86c9c-df66-5f66-b963-a159b6540ba1 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d86c9c-df66-5f66-b963-a159b6540ba1 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 23d86c9c-df66-5f66-b963-a159b6540ba1, identifier: 118953718
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118973565, 'registration': 'SF17KNK', 'account': 'STE132', 'make': 'FORD', 'model': 'TOURNEO CONNECT DIESEL ESTATE', 'derivative': '1.5 TDCi Zetec 5dr', 'mileage': 78218, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 120, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SF17KNK/2026-01-26/image/8a24cfad-c71b-4577-b493-126351a390a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2351dbd0-c8f8-48ad-bc20-720d0d1998a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/da504c30-e5df-433e-8d59-57939fd8f927_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2c3aefd9-cb3e-4c93-8edb-aead5db178d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/951db7c2-2037-438f-b926-0f923516641b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/b0292f99-c9c2-4559-8724-5253848d0b75_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2a843754-f748-4e13-983c-04824f58272e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/daf1b9d4-7d26-4a20-a056-ecce2ce7e00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/858853b9-7ac3-45ea-91a9-b4015c802ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/f076e042-d549-424f-8690-54951f6ab2cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-9k 06/19-20k 06/20-28k 08/25-78k', 'remarks': 'Ex-Private Hire // Wheelchair Accessible Vehicle', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec81b513-7283-4d3f-95a8-5b0e767d2d1d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118973565, 'registration': 'SF17KNK', 'account': 'STE132', 'make': 'FORD', 'model': 'TOURNEO CONNECT DIESEL ESTATE', 'derivative': '1.5 TDCi Zetec 5dr', 'mileage': 78218, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 120, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SF17KNK/2026-01-26/image/8a24cfad-c71b-4577-b493-126351a390a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2351dbd0-c8f8-48ad-bc20-720d0d1998a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/da504c30-e5df-433e-8d59-57939fd8f927_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2c3aefd9-cb3e-4c93-8edb-aead5db178d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/951db7c2-2037-438f-b926-0f923516641b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/b0292f99-c9c2-4559-8724-5253848d0b75_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/2a843754-f748-4e13-983c-04824f58272e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/daf1b9d4-7d26-4a20-a056-ecce2ce7e00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/858853b9-7ac3-45ea-91a9-b4015c802ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF17KNK/2026-01-26/image/f076e042-d549-424f-8690-54951f6ab2cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-9k 06/19-20k 06/20-28k 08/25-78k', 'remarks': 'Ex-Private Hire // Wheelchair Accessible Vehicle', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec81b513-7283-4d3f-95a8-5b0e767d2d1d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3904bc3-8059-565f-9860-67f5036124e2 with identifier: 118973565
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3904bc3-8059-565f-9860-67f5036124e2 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3904bc3-8059-565f-9860-67f5036124e2 with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b3904bc3-8059-565f-9860-67f5036124e2, identifier: 118973565
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118790658, 'registration': 'MV19VZC', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 108236, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 308, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV19VZC/2026-01-20/image/7ea4d36a-c9dd-4128-adc6-82d6c2035e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/2b859063-a44c-4dce-b732-905e19b0b4ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/00b841ca-e3c5-4725-88e5-bf00f9a452bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/1978c755-d0cb-4fbc-b27c-78f381b45e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/9f81f9bf-d7c1-4921-aac0-2b9c3263cf5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/5c930d41-2f48-4747-b0af-5e42a694a171_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/099213c9-15e3-4274-80a8-785c0be8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/bd0bfebe-cb00-48ee-98b9-4da5cfc36d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/1e372870-3f0b-4954-bf93-bc034a4dab8c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/22- NO MILEAGE, 06/23- NO MILEAGE, 01/24- NO MILEAGE, 07/25- NO MILEAGE, 12/25- NO MILEAGE,', 'remarks': '**475**VOSA STATES 36K, 53K, 71K, 91K SPARE KEY SD CARD', 'virtual': True, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcecea38-7f87-4242-a149-afa31c324e34.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118790658, 'registration': 'MV19VZC', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 108236, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 308, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV19VZC/2026-01-20/image/7ea4d36a-c9dd-4128-adc6-82d6c2035e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/2b859063-a44c-4dce-b732-905e19b0b4ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/00b841ca-e3c5-4725-88e5-bf00f9a452bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/1978c755-d0cb-4fbc-b27c-78f381b45e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/9f81f9bf-d7c1-4921-aac0-2b9c3263cf5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/5c930d41-2f48-4747-b0af-5e42a694a171_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/099213c9-15e3-4274-80a8-785c0be8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/bd0bfebe-cb00-48ee-98b9-4da5cfc36d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19VZC/2026-01-20/image/1e372870-3f0b-4954-bf93-bc034a4dab8c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/22- NO MILEAGE, 06/23- NO MILEAGE, 01/24- NO MILEAGE, 07/25- NO MILEAGE, 12/25- NO MILEAGE,', 'remarks': '**475**VOSA STATES 36K, 53K, 71K, 91K SPARE KEY SD CARD', 'virtual': True, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcecea38-7f87-4242-a149-afa31c324e34.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 709134d8-5b17-54a2-9f21-93cf3edb957e with identifier: 118790658
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 709134d8-5b17-54a2-9f21-93cf3edb957e with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 709134d8-5b17-54a2-9f21-93cf3edb957e with scrape type 2
2026-01-28 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 709134d8-5b17-54a2-9f21-93cf3edb957e, identifier: 118790658
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118261211, 'registration': 'FG71WZV', 'account': 'ZEN002', 'make': 'BMW', 'model': 'X3 ESTATE', 'derivative': 'xDrive 30e M Sport 5dr Auto', 'mileage': 58976, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 191, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 40K 57K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 47, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/02e23a58-5ed0-4e1e-ac7c-5f55dc78595b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118261211, 'registration': 'FG71WZV', 'account': 'ZEN002', 'make': 'BMW', 'model': 'X3 ESTATE', 'derivative': 'xDrive 30e M Sport 5dr Auto', 'mileage': 58976, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 191, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 40K 57K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 47, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/02e23a58-5ed0-4e1e-ac7c-5f55dc78595b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a8ebd4-2d28-51f6-881c-3581f6281976 with identifier: 118261211
2026-01-28 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a8ebd4-2d28-51f6-881c-3581f6281976 with scrape type 1
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252Fde5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 118953496
2026-01-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953496%27 HTTP/1.1" 200 None
2026-01-28 19:00:44 [astonbarclay.gb] INFO: Scrape type for 118953496: 2
2026-01-28 19:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3173504c-5b31-5921-8f6a-d0f049f2379f with identifier: 118222274
2026-01-28 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3173504c-5b31-5921-8f6a-d0f049f2379f with identifier: 118222274
2026-01-28 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130391 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
130391
2026-01-28 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3173504c-5b31-5921-8f6a-d0f049f2379f spider: astonbarclay.gb
2026-01-28 19:00:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3173504c-5b31-5921-8f6a-d0f049f2379f due to rule: high_mileage_for_make.json, error: 130391 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
130391
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '3173504c-5b31-5921-8f6a-d0f049f2379f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'AJ22KOU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118222274',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TESLA',
'model': 'MODEL Y HATCHBACK',
'odometer': 81022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seller_name': 'Zenith',
'title': 'TESLA MODEL Y HATCHBACK Long Range AWD 5dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118222274%27 HTTP/1.1" 200 None
2026-01-28 19:00:45 [astonbarclay.gb] INFO: Saving data for 118222274: {'auction_closing_time': 1769680800.0, 'created_time': 1768936736.66791, 'last_price_update_time': 1769626845.032061}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118222274') HTTP/1.1" 204 0
2026-01-28 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2c0a62f-58bc-59e4-a59c-fc20ed265a71 with identifier: 118934734
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2c0a62f-58bc-59e4-a59c-fc20ed265a71 with identifier: 118934734
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180587 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180587
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c2c0a62f-58bc-59e4-a59c-fc20ed265a71 spider: astonbarclay.gb
2026-01-28 19:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c2c0a62f-58bc-59e4-a59c-fc20ed265a71 due to rule: high_mileage_for_country.json, error: 180587 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180587
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c2c0a62f-58bc-59e4-a59c-fc20ed265a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KM17UFZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118934734',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'CITROEN',
'model': 'GRAND C4 PICASSO ESTATE',
'odometer': 112212,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': 'Fort Used Car Centre',
'title': 'CITROEN GRAND C4 PICASSO ESTATE 1.2 PureTech Feel 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Feel 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118934734%27 HTTP/1.1" 200 None
2026-01-28 19:00:45 [astonbarclay.gb] INFO: Saving data for 118934734: {'auction_closing_time': 1769680800.0, 'created_time': 1769194961.281412, 'last_price_update_time': 1769626845.331333}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118934734') HTTP/1.1" 204 0
2026-01-28 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 113aaed7-6ed9-5793-9283-93b173a686f4 with identifier: 118939194
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 113aaed7-6ed9-5793-9283-93b173a686f4 with identifier: 118939194
2026-01-28 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 113aaed7-6ed9-5793-9283-93b173a686f4 with identifier: 118939194 to the API
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118939194?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '113aaed7-6ed9-5793-9283-93b173a686f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RV17AKG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118939194',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 65425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-01',
'seller_name': 'Local Dealer Group',
'title': 'FORD FIESTA HATCHBACK 1.6 EcoBoost ST-2 5dr',
'transmission': 'manual',
'trim': '1.6 EcoBoost ST-2 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118939194%27 HTTP/1.1" 200 None
2026-01-28 19:00:45 [astonbarclay.gb] INFO: Saving data for 118939194: {'auction_closing_time': 1769680800.0, 'created_time': 1769195004.617901, 'last_price_update_time': 1769626845.610021}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118939194') HTTP/1.1" 204 0
2026-01-28 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 23d86c9c-df66-5f66-b963-a159b6540ba1 with identifier: 118953718
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 23d86c9c-df66-5f66-b963-a159b6540ba1 with identifier: 118953718
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193186 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
193186
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 23d86c9c-df66-5f66-b963-a159b6540ba1 spider: astonbarclay.gb
2026-01-28 19:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 23d86c9c-df66-5f66-b963-a159b6540ba1 due to rule: high_mileage_for_country.json, error: 193186 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
193186
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '23d86c9c-df66-5f66-b963-a159b6540ba1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VO17PNL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118953718',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'MAZDA',
'model': 'MAZDA6 DIESEL TOURER',
'odometer': 120041,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-07',
'seller_name': 'UKCGR - Select',
'title': 'MAZDA MAZDA6 DIESEL TOURER 2.2d [175] Sport Nav 5dr Auto',
'transmission': 'automatic',
'trim': '2.2d [175] Sport Nav 5dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953718%27 HTTP/1.1" 200 None
2026-01-28 19:00:45 [astonbarclay.gb] INFO: Saving data for 118953718: {'auction_closing_time': 1769680800.0, 'created_time': 1769281262.246322, 'last_price_update_time': 1769626845.823137}
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118953718') HTTP/1.1" 204 0
2026-01-28 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b3904bc3-8059-565f-9860-67f5036124e2 with identifier: 118973565
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b3904bc3-8059-565f-9860-67f5036124e2 with identifier: 118973565
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo connect diesel estate' containing 'tourneo'
2026-01-28 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b3904bc3-8059-565f-9860-67f5036124e2 spider: astonbarclay.gb
2026-01-28 19:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b3904bc3-8059-565f-9860-67f5036124e2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo connect diesel estate' containing 'tourneo'
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b3904bc3-8059-565f-9860-67f5036124e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SF17KNK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118973565',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'FORD',
'model': 'TOURNEO CONNECT DIESEL ESTATE',
'odometer': 78218,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seller_name': 'Local Dealer Group',
'title': 'FORD TOURNEO CONNECT DIESEL ESTATE 1.5 TDCi Zetec 5dr',
'transmission': 'manual',
'trim': '1.5 TDCi Zetec 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118973565%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Saving data for 118973565: {'auction_closing_time': 1769680800.0, 'created_time': 1769418060.656484, 'last_price_update_time': 1769626846.033142}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118973565') HTTP/1.1" 204 0
2026-01-28 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 709134d8-5b17-54a2-9f21-93cf3edb957e with identifier: 118790658
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 709134d8-5b17-54a2-9f21-93cf3edb957e with identifier: 118790658
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174188 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174188
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 709134d8-5b17-54a2-9f21-93cf3edb957e spider: astonbarclay.gb
2026-01-28 19:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 709134d8-5b17-54a2-9f21-93cf3edb957e due to rule: high_mileage_for_country.json, error: 174188 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174188
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '709134d8-5b17-54a2-9f21-93cf3edb957e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MV19VZC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118790658',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 108236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seller_name': 'UKCGR - Select',
'title': 'AUDI A3 SPORTBACK 35 TFSI S Line 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI S Line 5dr S Tronic',
'vin': None,
'year': 2019}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118790658%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Saving data for 118790658: {'auction_closing_time': 1769680800.0, 'created_time': 1768936518.598791, 'last_price_update_time': 1769626846.250686}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118790658') HTTP/1.1" 204 0
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118995171
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118995171%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118995171: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118632345
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118632345%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118632345: 2
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118119437, 'registration': 'YE71OKU', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI e Technik 5dr S Tronic', 'mileage': 95506, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 92, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-17', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-16', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71OKU/2025-12-23/image/ef9a8338-a94b-4010-8aec-c59526d2ffdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/7f267cb5-6d95-48f1-be2c-c087450d9541_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/f412bbc5-19b0-449f-be28-7f2ff30b78db_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/4b5b6265-6a59-4f48-9bcd-ff2e4982caad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/2005bd45-7fbf-4ccf-8868-36b9911a14e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/58b5cbfa-7801-4806-9077-a76f13db6f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/56f509e5-b393-4293-b460-66c5acd454a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/94fccc6e-9c11-4880-93bc-b70a9574600d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/483bac35-f678-4c3d-ac4d-c5e3b594b9a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/ee0db384-45a7-460e-ab46-4e87bcef9adb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/22-13K 06/23-31K 03/24-50K 08/24-61K 01/25-76K 11/25-91K', 'remarks': 'VOSA STATES 68K 93K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 36, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1474eb28-d12c-4c2e-8112-eeb6a65ee857.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118119437, 'registration': 'YE71OKU', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI e Technik 5dr S Tronic', 'mileage': 95506, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 92, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-17', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-16', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71OKU/2025-12-23/image/ef9a8338-a94b-4010-8aec-c59526d2ffdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/7f267cb5-6d95-48f1-be2c-c087450d9541_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/f412bbc5-19b0-449f-be28-7f2ff30b78db_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/4b5b6265-6a59-4f48-9bcd-ff2e4982caad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/2005bd45-7fbf-4ccf-8868-36b9911a14e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/58b5cbfa-7801-4806-9077-a76f13db6f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/56f509e5-b393-4293-b460-66c5acd454a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/94fccc6e-9c11-4880-93bc-b70a9574600d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/483bac35-f678-4c3d-ac4d-c5e3b594b9a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71OKU/2025-12-23/image/ee0db384-45a7-460e-ab46-4e87bcef9adb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/22-13K 06/23-31K 03/24-50K 08/24-61K 01/25-76K 11/25-91K', 'remarks': 'VOSA STATES 68K 93K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 36, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1474eb28-d12c-4c2e-8112-eeb6a65ee857.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689b8257-a3ed-5fab-a53b-7bfa9518a30b with identifier: 118119437
2026-01-28 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689b8257-a3ed-5fab-a53b-7bfa9518a30b with scrape type 2
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689b8257-a3ed-5fab-a53b-7bfa9518a30b with scrape type 2
2026-01-28 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 689b8257-a3ed-5fab-a53b-7bfa9518a30b, identifier: 118119437
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 689b8257-a3ed-5fab-a53b-7bfa9518a30b with identifier: 118119437
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 689b8257-a3ed-5fab-a53b-7bfa9518a30b with identifier: 118119437
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153701 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153701
2026-01-28 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 689b8257-a3ed-5fab-a53b-7bfa9518a30b spider: astonbarclay.gb
2026-01-28 19:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 689b8257-a3ed-5fab-a53b-7bfa9518a30b due to rule: high_mileage_for_country.json, error: 153701 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153701
{'auction_title': '',
'c_o_2_emission_value': 36,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '689b8257-a3ed-5fab-a53b-7bfa9518a30b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YE71OKU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118119437',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'AUDI',
'model': 'Q3 ESTATE',
'odometer': 95506,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-17',
'seller_name': 'Zenith',
'title': 'AUDI Q3 ESTATE 45 TFSI e Technik 5dr S Tronic',
'transmission': 'automatic',
'trim': '45 TFSI e Technik 5dr S Tronic',
'vin': None,
'year': 2021}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118119437%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Saving data for 118119437: {'auction_closing_time': 1769680800.0, 'created_time': 1767986487.625807, 'last_price_update_time': 1769626846.628981}
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118119437') HTTP/1.1" 204 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 119052700
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052700%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 119052700: 1
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118560200
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118560200%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118560200: 2
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118983656
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118983656%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118983656: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118962512
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118962512%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118962512: 2
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252Fb7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 119036841
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036841%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 119036841: 1
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118601076
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118601076%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118601076: 2
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118992428
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992428%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118992428: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118992366
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992366%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118992366: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118889710
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118889710%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118889710: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118991223
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991223%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118991223: 0
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118748001
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118748001%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118748001: 2
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118988916
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118988916%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 118988916: 2
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 119036683
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036683%27 HTTP/1.1" 200 None
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Scrape type for 119036683: 1
2026-01-28 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 118985649
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118985649%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118985649: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118991875
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991875%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118991875: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118989212
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989212%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118989212: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118846650
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118846650%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118846650: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118868712
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118868712%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118868712: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119045223
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045223%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119045223: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119040443
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119040443%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119040443: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119044353
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044353%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119044353: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118809412
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118809412%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118809412: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118806045
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118806045%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118806045: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119045936
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045936%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119045936: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118714031
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118714031%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118714031: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118902920
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118902920%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118902920: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118823496
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118823496%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118823496: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118421149
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118421149%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118421149: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118472330
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118472330%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118472330: 2
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118889322
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118889322%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118889322: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118952238
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118952238%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118952238: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118915920
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118915920%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118915920: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119099618
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099618%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119099618: 1
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119049835
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119049835%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119049835: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119092918
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119092918%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119092918: 1
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118900408
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118900408%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118900408: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118964467
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964467%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118964467: 1
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118872928
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118872928%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118872928: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119092570
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119092570%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119092570: 1
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118991898
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991898%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118991898: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118723445
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723445%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118723445: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119091796
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091796%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119091796: 1
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119054318
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054318%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119054318: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118571581
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118571581%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118571581: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119097002
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097002%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119097002: 1
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119028206
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119028206%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119028206: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119097670
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097670%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119097670: 1
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119030879
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030879%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119030879: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118991543
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991543%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118991543: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118494316
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118494316%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118494316: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118958465
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118958465%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118958465: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118872463
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118872463%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118872463: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119079251
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119079251%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119079251: 1
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117630402?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117918622?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118654345?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118654422, 'registration': 'DN22XWV', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr', 'mileage': 36618, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 328, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24 19K 05/25 34K', 'remarks': 'VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bb2da14-931b-4c56-80ad-c35c41751e50.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118654422, 'registration': 'DN22XWV', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr', 'mileage': 36618, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 328, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24 19K 05/25 34K', 'remarks': 'VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bb2da14-931b-4c56-80ad-c35c41751e50.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044f1413-6fad-5d88-a24a-84f4f36bc672 with identifier: 118654422
2026-01-28 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044f1413-6fad-5d88-a24a-84f4f36bc672 with scrape type 1
2026-01-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fb4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119031861
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119031861%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119031861: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118650450
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118650450%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118650450: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118981982
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118981982%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118981982: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118976406
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118976406%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118976406: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118992897
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992897%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118992897: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 118990974
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990974%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 118990974: 0
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119053592
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053592%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119053592: 1
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252F5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117773000?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118068611?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119091175
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091175%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119091175: 1
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117831433?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252F3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 119045738
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045738%27 HTTP/1.1" 200 None
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Scrape type for 119045738: 1
2026-01-28 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117864894?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117630402, 'registration': 'GU72VTP', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23655, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 351, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VTP/2026-01-19/image/249a61e9-e8c7-46f0-a881-f2f533bd3ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/465d88be-1b07-4511-b6e0-d446429a860e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/bf1fe670-e475-4358-a46e-94d34c47fa81_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/3bd5347e-acbd-4255-a152-bcea7de0efb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/8725febd-0a61-43c4-86f1-7ed69af6a850_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/662935c5-86fd-4095-aa49-caea90881aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/f55fc00d-5417-407c-b9e0-51d088319909_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/baa503b4-7c4a-41ca-b90d-c1342c6f4361_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-9k, 10/24-17k, 11/25-21k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa44c458-b206-4bc3-90cf-310402058acd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117630402, 'registration': 'GU72VTP', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23655, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 351, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VTP/2026-01-19/image/249a61e9-e8c7-46f0-a881-f2f533bd3ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/465d88be-1b07-4511-b6e0-d446429a860e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/bf1fe670-e475-4358-a46e-94d34c47fa81_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/3bd5347e-acbd-4255-a152-bcea7de0efb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/8725febd-0a61-43c4-86f1-7ed69af6a850_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/662935c5-86fd-4095-aa49-caea90881aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/f55fc00d-5417-407c-b9e0-51d088319909_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VTP/2026-01-19/image/baa503b4-7c4a-41ca-b90d-c1342c6f4361_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-9k, 10/24-17k, 11/25-21k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa44c458-b206-4bc3-90cf-310402058acd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a89b922-0e85-51de-acda-463f4c6ed80b with identifier: 117630402
2026-01-28 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a89b922-0e85-51de-acda-463f4c6ed80b with scrape type 2
2026-01-28 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a89b922-0e85-51de-acda-463f4c6ed80b with scrape type 2
2026-01-28 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a89b922-0e85-51de-acda-463f4c6ed80b, identifier: 117630402
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117918622, 'registration': 'GV22WJZ', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 59253, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 356, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-18', 'fuel': 'Electric', 'motExpiry': '2026-07-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/e2649d87-c48a-4c21-b287-8d544a702c19_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/a30ef4aa-44c4-4d85-84a8-6a1a7a9f86a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/74e70b3c-4009-41f2-a837-a990ddde656c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/3c42e8d4-a81f-448e-ae1b-dbbe838a1001_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/97a78372-b29e-4fbe-8d9a-63bfe956c866_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/6a5421c5-e957-40af-9f2f-436f183711c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/e7d8d58b-894a-499a-89f7-05f0f9cd688a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/ec21eeeb-c255-4fa0-9415-5425499a9cbb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23-12K', 'remarks': 'SPARE KEY, VOSA STATES 52K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26060437-64f8-444e-aa40-01fb940cf4ee.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117918622, 'registration': 'GV22WJZ', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 59253, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 356, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-18', 'fuel': 'Electric', 'motExpiry': '2026-07-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/e2649d87-c48a-4c21-b287-8d544a702c19_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/a30ef4aa-44c4-4d85-84a8-6a1a7a9f86a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/74e70b3c-4009-41f2-a837-a990ddde656c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/3c42e8d4-a81f-448e-ae1b-dbbe838a1001_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/97a78372-b29e-4fbe-8d9a-63bfe956c866_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/6a5421c5-e957-40af-9f2f-436f183711c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/e7d8d58b-894a-499a-89f7-05f0f9cd688a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV22WJZ/2025-12-11/image/ec21eeeb-c255-4fa0-9415-5425499a9cbb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23-12K', 'remarks': 'SPARE KEY, VOSA STATES 52K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26060437-64f8-444e-aa40-01fb940cf4ee.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382e3bbd-fae0-53df-8161-83c93a166209 with identifier: 117918622
2026-01-28 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382e3bbd-fae0-53df-8161-83c93a166209 with scrape type 2
2026-01-28 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382e3bbd-fae0-53df-8161-83c93a166209 with scrape type 2
2026-01-28 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 382e3bbd-fae0-53df-8161-83c93a166209, identifier: 117918622
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118654345, 'registration': 'DL22NEN', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Visia 5dr', 'mileage': 21208, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 331, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-22', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL22NEN/2026-01-28/image/1e374bb1-425f-4bc3-ae67-011adb20b013_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/9f74e49c-2e42-418f-8985-61367f0aca7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/04e6b035-1b3c-4de8-9c9e-0ebdf1b80b62_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/4257337d-3091-4f9f-b7ee-0383026f3b53_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/aaaf4b05-d0b6-4fb4-9be1-7fd9592f7678_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/3f74d937-3b37-41e7-bb44-50e1bb56e840_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/d3d80ade-63de-4a1d-bdf0-a93e329f1441_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/45051313-391e-4bf5-8e19-873bc2b54cce_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/23 9K 07/24 13K 06/25 20K', 'remarks': 'VOSA STATES 20K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b2ba436-6362-4872-9eb0-107d6cf2ee02.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118654345, 'registration': 'DL22NEN', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Visia 5dr', 'mileage': 21208, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 331, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-22', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL22NEN/2026-01-28/image/1e374bb1-425f-4bc3-ae67-011adb20b013_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/9f74e49c-2e42-418f-8985-61367f0aca7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/04e6b035-1b3c-4de8-9c9e-0ebdf1b80b62_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/4257337d-3091-4f9f-b7ee-0383026f3b53_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/aaaf4b05-d0b6-4fb4-9be1-7fd9592f7678_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/3f74d937-3b37-41e7-bb44-50e1bb56e840_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/d3d80ade-63de-4a1d-bdf0-a93e329f1441_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL22NEN/2026-01-28/image/45051313-391e-4bf5-8e19-873bc2b54cce_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/23 9K 07/24 13K 06/25 20K', 'remarks': 'VOSA STATES 20K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b2ba436-6362-4872-9eb0-107d6cf2ee02.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194344c9-e631-5708-9b9a-7594dc40ddd6 with identifier: 118654345
2026-01-28 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194344c9-e631-5708-9b9a-7594dc40ddd6 with scrape type 2
2026-01-28 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194344c9-e631-5708-9b9a-7594dc40ddd6 with scrape type 2
2026-01-28 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 194344c9-e631-5708-9b9a-7594dc40ddd6, identifier: 118654345
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fa978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a89b922-0e85-51de-acda-463f4c6ed80b with identifier: 117630402
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a89b922-0e85-51de-acda-463f4c6ed80b with identifier: 117630402
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 23655, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630402', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vtp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6a89b922-0e85-51de-acda-463f4c6ed80b', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 38068} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '6a89b922-0e85-51de-acda-463f4c6ed80b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vtp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630402',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 23655,
'odometer_in_km': 38068,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6a89b922-0e85-51de-acda-463f4c6ed80b spider: astonbarclay.gb
2026-01-28 19:00:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6a89b922-0e85-51de-acda-463f4c6ed80b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 23655, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630402', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vtp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6a89b922-0e85-51de-acda-463f4c6ed80b', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 38068} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '6a89b922-0e85-51de-acda-463f4c6ed80b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vtp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630402',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 23655,
'odometer_in_km': 38068,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '6a89b922-0e85-51de-acda-463f4c6ed80b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GU72VTP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630402',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'MERCEDES-BENZ',
'model': 'EQC ESTATE',
'odometer': 23655,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seller_name': 'Kinto',
'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117630402%27 HTTP/1.1" 200 None
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Saving data for 117630402: {'auction_closing_time': 1769680800.0, 'created_time': 1768849321.575058, 'last_price_update_time': 1769626848.544315}
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117630402') HTTP/1.1" 204 0
2026-01-28 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 382e3bbd-fae0-53df-8161-83c93a166209 with identifier: 117918622
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 382e3bbd-fae0-53df-8161-83c93a166209 with identifier: 117918622
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 59253, 'odometer_reading_unit': 'mi', 'registration_date': '2022-08-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117918622', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gv22wjz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '382e3bbd-fae0-53df-8161-83c93a166209', 'current_year_diff': 4, 'age_in_months': 41, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 95358} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '382e3bbd-fae0-53df-8161-83c93a166209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gv22wjz',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117918622',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 59253,
'odometer_in_km': 95358,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-18',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 382e3bbd-fae0-53df-8161-83c93a166209 spider: astonbarclay.gb
2026-01-28 19:00:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 382e3bbd-fae0-53df-8161-83c93a166209 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 59253, 'odometer_reading_unit': 'mi', 'registration_date': '2022-08-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117918622', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gv22wjz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '382e3bbd-fae0-53df-8161-83c93a166209', 'current_year_diff': 4, 'age_in_months': 41, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 95358} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '382e3bbd-fae0-53df-8161-83c93a166209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gv22wjz',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117918622',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 59253,
'odometer_in_km': 95358,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-18',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '382e3bbd-fae0-53df-8161-83c93a166209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GV22WJZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117918622',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'MERCEDES-BENZ',
'model': 'EQC ESTATE',
'odometer': 59253,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-18',
'seller_name': 'Kinto',
'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117918622%27 HTTP/1.1" 200 None
2026-01-28 19:00:48 [astonbarclay.gb] INFO: Saving data for 117918622: {'auction_closing_time': 1769680800.0, 'created_time': 1768849366.425069, 'last_price_update_time': 1769626848.869386}
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117918622') HTTP/1.1" 204 0
2026-01-28 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 194344c9-e631-5708-9b9a-7594dc40ddd6 with identifier: 118654345
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2026-01-28 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 194344c9-e631-5708-9b9a-7594dc40ddd6 with identifier: 118654345
2026-01-28 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 194344c9-e631-5708-9b9a-7594dc40ddd6 with identifier: 118654345 to the API
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27194344c9-e631-5708-9b9a-7594dc40ddd6%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 194344c9-e631-5708-9b9a-7594dc40ddd6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118654345?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '194344c9-e631-5708-9b9a-7594dc40ddd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DL22NEN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118654345',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 21208,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Visia 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T MH Visia 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654345%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Saving data for 118654345: {'created_time': 1769454232.267197, 'last_price_update_time': 1769626849.466717, 'auction_closing_time': 1769680800.0}
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118654345') HTTP/1.1" 204 0
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 119032694
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119032694%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 119032694: 0
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 118987846
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987846%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 118987846: 0
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 118989144
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989144%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 118989144: 0
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 118879129
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118879129%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 118879129: 2
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fde3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 118794195
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118794195%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 118794195: 0
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 118602418
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118602418%27 HTTP/1.1" 200 None
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Scrape type for 118602418: 2
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117773000, 'registration': 'GU72YKP', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 18452, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 353, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-21', 'fuel': 'Electric', 'motExpiry': '2026-09-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKP/2025-12-09/image/fb70d130-e458-4713-b806-0a04e1ba4ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/256df2e4-671e-451b-a03b-5fb373535205_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/0bdf0fa5-4fef-493a-a8c1-984674bbc5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/9be88a7a-f3ae-4be5-9a13-0ec0c02abb0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/1e4e0dd5-c534-45c3-97f7-51c4768668fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f0688b54-23a8-46a1-9299-d3f5b6120d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f3ac3ca2-4b99-4951-b78f-83c11af47689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f2f31a88-7faf-430a-9040-3a87436cfa10_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 5K 09/24 10K 09/25 17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76f9cb40-c9a7-489c-824b-c0962086bb70.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117773000, 'registration': 'GU72YKP', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 18452, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 353, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-21', 'fuel': 'Electric', 'motExpiry': '2026-09-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKP/2025-12-09/image/fb70d130-e458-4713-b806-0a04e1ba4ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/256df2e4-671e-451b-a03b-5fb373535205_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/0bdf0fa5-4fef-493a-a8c1-984674bbc5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/9be88a7a-f3ae-4be5-9a13-0ec0c02abb0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/1e4e0dd5-c534-45c3-97f7-51c4768668fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f0688b54-23a8-46a1-9299-d3f5b6120d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f3ac3ca2-4b99-4951-b78f-83c11af47689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKP/2025-12-09/image/f2f31a88-7faf-430a-9040-3a87436cfa10_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 5K 09/24 10K 09/25 17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76f9cb40-c9a7-489c-824b-c0962086bb70.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a406b0ce-2d87-5b90-8c2a-292d7960193d with identifier: 117773000
2026-01-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a406b0ce-2d87-5b90-8c2a-292d7960193d with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a406b0ce-2d87-5b90-8c2a-292d7960193d with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a406b0ce-2d87-5b90-8c2a-292d7960193d, identifier: 117773000
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118068611, 'registration': 'BP72PCO', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '100kW Premium 39kWh 5dr Auto', 'mileage': 20505, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 355, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-01-10', 'fuel': 'Electric', 'motExpiry': '2027-01-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP72PCO/2025-12-18/image/61994f36-3ecf-4e8e-b1f1-215f1b3339d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/64b91dcb-9366-41fc-aa08-5a6ed50079be_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/01c98195-b7ed-4af8-9b2b-06068ca30c02_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/1fdc308d-72ec-4d1d-bb86-daefdbbe3045_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/de81e8ce-e9a4-4b3d-99e1-b0efa64ae47c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/ab6d07cd-b7e3-4314-bdcf-f8fb01916bf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/9e0628e1-0311-4f0e-871d-bfecde26711f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/bef55fdc-02ab-4564-8d91-59e42475a7cb_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K 11/24 12K', 'remarks': 'SPARE KEY, *Special solid - Ignite red, Cloth - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff00695e-2933-4d74-83ab-80dd86f16876.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118068611, 'registration': 'BP72PCO', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '100kW Premium 39kWh 5dr Auto', 'mileage': 20505, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 355, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-01-10', 'fuel': 'Electric', 'motExpiry': '2027-01-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP72PCO/2025-12-18/image/61994f36-3ecf-4e8e-b1f1-215f1b3339d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/64b91dcb-9366-41fc-aa08-5a6ed50079be_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/01c98195-b7ed-4af8-9b2b-06068ca30c02_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/1fdc308d-72ec-4d1d-bb86-daefdbbe3045_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/de81e8ce-e9a4-4b3d-99e1-b0efa64ae47c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/ab6d07cd-b7e3-4314-bdcf-f8fb01916bf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/9e0628e1-0311-4f0e-871d-bfecde26711f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72PCO/2025-12-18/image/bef55fdc-02ab-4564-8d91-59e42475a7cb_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K 11/24 12K', 'remarks': 'SPARE KEY, *Special solid - Ignite red, Cloth - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff00695e-2933-4d74-83ab-80dd86f16876.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 with identifier: 118068611
2026-01-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6, identifier: 118068611
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117831433, 'registration': 'RJ72YTU', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 109480, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 346, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/510db224-9291-4545-8cfb-72fff4080567_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/71d1b80f-0967-4741-bbbd-a02e1ec933f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/4ed8fa76-92c4-48e0-8917-ac837e331c98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/e73365b2-572b-4570-bb3a-4cdc6fbb257c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/2014e2f4-124b-4ae9-9ece-eaf708cffe27_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/393209c1-153a-420b-b50e-4db6ff2b301d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/00aa5a76-9221-4716-a2ae-0e9b88743b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/51f06179-5664-452a-a755-9213f998a528_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23-33K 01/24-37K 01/25-74K', 'remarks': 'Ex-Private Hire, VOSA STATES 10K 34K 49K 69K 90K, SPARE KEY', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/231b17d4-6bf6-4ec8-a729-85734bd6a1a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117831433, 'registration': 'RJ72YTU', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 109480, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 346, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/510db224-9291-4545-8cfb-72fff4080567_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/71d1b80f-0967-4741-bbbd-a02e1ec933f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/4ed8fa76-92c4-48e0-8917-ac837e331c98_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/e73365b2-572b-4570-bb3a-4cdc6fbb257c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/2014e2f4-124b-4ae9-9ece-eaf708cffe27_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/393209c1-153a-420b-b50e-4db6ff2b301d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/00aa5a76-9221-4716-a2ae-0e9b88743b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YTU/2025-12-17/image/51f06179-5664-452a-a755-9213f998a528_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23-33K 01/24-37K 01/25-74K', 'remarks': 'Ex-Private Hire, VOSA STATES 10K 34K 49K 69K 90K, SPARE KEY', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/231b17d4-6bf6-4ec8-a729-85734bd6a1a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d918848-7853-5f87-b649-6a841e6777aa with identifier: 117831433
2026-01-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d918848-7853-5f87-b649-6a841e6777aa with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d918848-7853-5f87-b649-6a841e6777aa with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3d918848-7853-5f87-b649-6a841e6777aa, identifier: 117831433
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117864894, 'registration': 'RF72LCC', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 91514, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 345, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72LCC/2025-12-17/image/f9ae7084-08c7-4e89-95b3-586067724cd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/f491a13a-5ff1-4328-9cc0-efb8e2bf51cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/8207cf95-87f3-4e55-863a-154665604312_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/0c8bdeef-e4fe-453f-bcdf-e82be6a124a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/08d84d49-e4ca-4b30-8a15-143e971ee2ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/9176f00d-f348-461a-a196-a5427290d84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/ff1d1ed8-b8d3-4f0c-af2e-9643dcddce6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/fddd14d3-4d5f-4f43-8ade-b6cfe110ecc0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23 22K 11/24 51K 01/25 56K', 'remarks': 'Ex-Private Hire, VOSA STATES 9K 23K 38K 58K 78K SPARE KEY', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/22c62238-e1d2-41e2-be2a-631d71593381.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117864894, 'registration': 'RF72LCC', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 91514, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 345, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RF72LCC/2025-12-17/image/f9ae7084-08c7-4e89-95b3-586067724cd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/f491a13a-5ff1-4328-9cc0-efb8e2bf51cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/8207cf95-87f3-4e55-863a-154665604312_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/0c8bdeef-e4fe-453f-bcdf-e82be6a124a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/08d84d49-e4ca-4b30-8a15-143e971ee2ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/9176f00d-f348-461a-a196-a5427290d84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/ff1d1ed8-b8d3-4f0c-af2e-9643dcddce6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF72LCC/2025-12-17/image/fddd14d3-4d5f-4f43-8ade-b6cfe110ecc0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23 22K 11/24 51K 01/25 56K', 'remarks': 'Ex-Private Hire, VOSA STATES 9K 23K 38K 58K 78K SPARE KEY', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/22c62238-e1d2-41e2-be2a-631d71593381.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1047323-cdd9-540a-b03f-4828f1f8f2bf with identifier: 117864894
2026-01-28 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1047323-cdd9-540a-b03f-4828f1f8f2bf with scrape type 2
2026-01-28 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1047323-cdd9-540a-b03f-4828f1f8f2bf with scrape type 2
2026-01-28 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f1047323-cdd9-540a-b03f-4828f1f8f2bf, identifier: 117864894
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fd4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a406b0ce-2d87-5b90-8c2a-292d7960193d with identifier: 117773000
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a406b0ce-2d87-5b90-8c2a-292d7960193d with identifier: 117773000
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18452, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-21', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773000', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72ykp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a406b0ce-2d87-5b90-8c2a-292d7960193d', 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 29695} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'a406b0ce-2d87-5b90-8c2a-292d7960193d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72ykp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773000',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 18452,
'odometer_in_km': 29695,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-21',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a406b0ce-2d87-5b90-8c2a-292d7960193d spider: astonbarclay.gb
2026-01-28 19:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a406b0ce-2d87-5b90-8c2a-292d7960193d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18452, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-21', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773000', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72ykp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a406b0ce-2d87-5b90-8c2a-292d7960193d', 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 29695} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'a406b0ce-2d87-5b90-8c2a-292d7960193d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72ykp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773000',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 18452,
'odometer_in_km': 29695,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-21',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'a406b0ce-2d87-5b90-8c2a-292d7960193d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GU72YKP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773000',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'MERCEDES-BENZ',
'model': 'EQC ESTATE',
'odometer': 18452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-21',
'seller_name': 'Kinto',
'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117773000%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Saving data for 117773000: {'auction_closing_time': 1769680800.0, 'created_time': 1768849523.173515, 'last_price_update_time': 1769626850.23587}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117773000') HTTP/1.1" 204 0
2026-01-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 with identifier: 118068611
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 with identifier: 118068611
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 100kw premium 39kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20505, 'odometer_reading_unit': 'mi', 'registration_date': '2023-01-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118068611', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw premium 39kwh 5dr auto', 'license_plate': 'bp72pco', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 32999} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'bp72pco',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118068611',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'hyundai',
'make_model': 'hyundai kona electric hatchback',
'model': 'kona electric hatchback',
'odometer': 20505,
'odometer_in_km': 32999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'sanitized_make': 'hyundai',
'seller_name': 'kinto',
'title': 'hyundai kona electric hatchback 100kw premium 39kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw premium 39kwh 5dr auto',
'vin': None,
'year': 2023}
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 spider: astonbarclay.gb
2026-01-28 19:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 100kw premium 39kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20505, 'odometer_reading_unit': 'mi', 'registration_date': '2023-01-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118068611', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw premium 39kwh 5dr auto', 'license_plate': 'bp72pco', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 32999} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'bp72pco',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118068611',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'hyundai',
'make_model': 'hyundai kona electric hatchback',
'model': 'kona electric hatchback',
'odometer': 20505,
'odometer_in_km': 32999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'sanitized_make': 'hyundai',
'seller_name': 'kinto',
'title': 'hyundai kona electric hatchback 100kw premium 39kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw premium 39kwh 5dr auto',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '221bc0e8-b07d-5d5d-96a1-ebc9207bf3b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BP72PCO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118068611',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'HYUNDAI',
'model': 'KONA ELECTRIC HATCHBACK',
'odometer': 20505,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'seller_name': 'Kinto',
'title': 'HYUNDAI KONA ELECTRIC HATCHBACK 100kW Premium 39kWh 5dr Auto',
'transmission': 'automatic',
'trim': '100kW Premium 39kWh 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118068611%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Saving data for 118068611: {'auction_closing_time': 1769680800.0, 'created_time': 1768849518.823727, 'last_price_update_time': 1769626850.450136}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118068611') HTTP/1.1" 204 0
2026-01-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3d918848-7853-5f87-b649-6a841e6777aa with identifier: 117831433
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3d918848-7853-5f87-b649-6a841e6777aa with identifier: 117831433
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176190 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
176190
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3d918848-7853-5f87-b649-6a841e6777aa spider: astonbarclay.gb
2026-01-28 19:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3d918848-7853-5f87-b649-6a841e6777aa due to rule: high_mileage_for_country.json, error: 176190 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
176190
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '3d918848-7853-5f87-b649-6a841e6777aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ72YTU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831433',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 109480,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831433%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Saving data for 117831433: {'auction_closing_time': 1769680800.0, 'created_time': 1767986444.327753, 'last_price_update_time': 1769626850.661189}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117831433') HTTP/1.1" 204 0
2026-01-28 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f1047323-cdd9-540a-b03f-4828f1f8f2bf with identifier: 117864894
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f1047323-cdd9-540a-b03f-4828f1f8f2bf with identifier: 117864894
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 91514, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864894', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rf72lcc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f1047323-cdd9-540a-b03f-4828f1f8f2bf', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 147277} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'f1047323-cdd9-540a-b03f-4828f1f8f2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rf72lcc',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864894',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 91514,
'odometer_in_km': 147277,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f1047323-cdd9-540a-b03f-4828f1f8f2bf spider: astonbarclay.gb
2026-01-28 19:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f1047323-cdd9-540a-b03f-4828f1f8f2bf due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'addison lee', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 91514, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864894', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '128kw life pro 77kwh 5dr auto [135kw ch]', 'license_plate': 'rf72lcc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f1047323-cdd9-540a-b03f-4828f1f8f2bf', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 147277} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'f1047323-cdd9-540a-b03f-4828f1f8f2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'rf72lcc',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864894',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 91514,
'odometer_in_km': 147277,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'sanitized_make': 'volkswagen',
'seller_name': 'addison lee',
'title': 'volkswagen id.4 estate 128kw life pro 77kwh 5dr auto [135kw '
'ch]',
'transmission': 'automatic',
'trim': '128kw life pro 77kwh 5dr auto [135kw ch]',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'f1047323-cdd9-540a-b03f-4828f1f8f2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RF72LCC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117864894',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 91514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117864894%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Saving data for 117864894: {'auction_closing_time': 1769680800.0, 'created_time': 1767986548.316469, 'last_price_update_time': 1769626850.887505}
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117864894') HTTP/1.1" 204 0
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 118392993
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118392993%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Scrape type for 118392993: 0
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 118929745
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118929745%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Scrape type for 118929745: 0
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 118485440
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118485440%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Scrape type for 118485440: 2
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Ff30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119099541?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 119038790
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119038790%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119038790: 1
2026-01-28 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fb06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118939129
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118939129%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118939129: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119052520
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052520%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119052520: 1
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118941302
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118941302%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118941302: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119019822
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119019822%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119019822: 1
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119044107
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044107%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119044107: 1
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118589633
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118589633%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118589633: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118457300
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118457300%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118457300: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 116617318: 2
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119028522
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119028522%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119028522: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118984027
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118984027%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118984027: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118997520
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118997520%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118997520: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118682299
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118682299%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118682299: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119028223
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119028223%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119028223: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118776960
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118776960%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118776960: 2
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119099541, 'registration': 'DX22YNP', 'account': 'KTL001', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 GT-line 5dr [4 seats]', 'mileage': 32537, 'mileageWarranty': False, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 315, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-29', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**1710** VOSA STATES 32K, OUTSTANDING RECALL, V5 PHOTOCOPY FRONT PAGE ONLY', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119099541, 'registration': 'DX22YNP', 'account': 'KTL001', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 GT-line 5dr [4 seats]', 'mileage': 32537, 'mileageWarranty': False, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 315, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-29', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**1710** VOSA STATES 32K, OUTSTANDING RECALL, V5 PHOTOCOPY FRONT PAGE ONLY', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c with identifier: 119099541
2026-01-28 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c with scrape type 1
2026-01-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c
2026-01-28 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c
2026-01-28 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c, identifier: 119099541
2026-01-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118890833
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118890833%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118890833: 2
2026-01-28 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c with identifier: 119099541
2026-01-28 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c with identifier: 119099541
2026-01-28 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c with identifier: 119099541 to the API
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:50 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119099541?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': 'bf63bbf4-381c-50b1-a1c1-6c3fd6132d6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DX22YNP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119099541',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'KIA',
'model': 'PICANTO HATCHBACK',
'odometer': 32537,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seller_name': 'Kia Specialist',
'title': 'KIA PICANTO HATCHBACK 1.0 GT-line 5dr [4 seats]',
'transmission': 'manual',
'trim': '1.0 GT-line 5dr [4 seats]',
'vin': None,
'year': 2022}
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099541%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Saving data for 119099541: {'created_time': 1769626851.665012, 'last_price_update_time': 1769626851.665026, 'auction_closing_time': 1769766300.0}
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119099541') HTTP/1.1" 204 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 118973342
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118973342%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 118973342: 0
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 119098627
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119098627%27 HTTP/1.1" 200 None
2026-01-28 19:00:51 [astonbarclay.gb] INFO: Scrape type for 119098627: 1
2026-01-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118683189?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118347430?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118651836?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117768126?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319049bd10>
2026-01-28 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fb4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600 saved to cache
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 118407199
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118407199%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 118407199: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 118993599
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118993599%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 118993599: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119048987
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119048987%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119048987: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119052331
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052331%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119052331: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119054700
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054700%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119054700: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119037197
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037197%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119037197: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 118888261
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118888261%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 118888261: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119095442
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119095442%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119095442: 1
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119022154
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022154%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119022154: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119036982
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036982%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119036982: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 118600652
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118600652%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 118600652: 0
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 119089043
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119089043%27 HTTP/1.1" 200 None
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Scrape type for 119089043: 1
2026-01-28 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118245988?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118387645?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118158100?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118683189, 'registration': 'KF72VBT', 'account': 'ARN073', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Design 5dr CVT', 'mileage': 21240, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 301, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-12', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2027-01-11', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF72VBT/2026-01-16/image/dd233d4e-f46b-458d-885a-3b10430dc9dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/9be6e16f-0dc3-44cf-888c-cd50ed848138_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/319744b6-2738-430a-aed5-dd057576bc16_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/c2a30ecb-540e-422c-9d4e-56c447b1b354_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/f9503fd5-4adf-43cc-8ea8-a3dc2bdecdde_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/898fc6cc-95f3-4184-80ee-5bff02e77095_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/221e5724-f3d6-4680-bfa6-bc1902dafe3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/3cac15c5-018f-418a-9372-41c634e683da_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/1aa1187c-ff7a-4c0f-afc6-c9889d95ed42_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 - 7K', 'remarks': '**1631** VOSA STATES 20K', 'virtual': False, 'seller': 'Arnold Limousines', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a213d736-28c9-4184-af21-8121cb1639cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118683189, 'registration': 'KF72VBT', 'account': 'ARN073', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Design 5dr CVT', 'mileage': 21240, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 301, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-12', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2027-01-11', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF72VBT/2026-01-16/image/dd233d4e-f46b-458d-885a-3b10430dc9dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/9be6e16f-0dc3-44cf-888c-cd50ed848138_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/319744b6-2738-430a-aed5-dd057576bc16_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/c2a30ecb-540e-422c-9d4e-56c447b1b354_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/f9503fd5-4adf-43cc-8ea8-a3dc2bdecdde_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/898fc6cc-95f3-4184-80ee-5bff02e77095_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/221e5724-f3d6-4680-bfa6-bc1902dafe3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/3cac15c5-018f-418a-9372-41c634e683da_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF72VBT/2026-01-16/image/1aa1187c-ff7a-4c0f-afc6-c9889d95ed42_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 - 7K', 'remarks': '**1631** VOSA STATES 20K', 'virtual': False, 'seller': 'Arnold Limousines', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a213d736-28c9-4184-af21-8121cb1639cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47449341-aae5-5b6c-9353-6cebf59b619f with identifier: 118683189
2026-01-28 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47449341-aae5-5b6c-9353-6cebf59b619f with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47449341-aae5-5b6c-9353-6cebf59b619f with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 47449341-aae5-5b6c-9353-6cebf59b619f, identifier: 118683189
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118347430, 'registration': 'YF72ONL', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI GTE 5dr DSG', 'mileage': 10353, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 104, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-29', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72ONL/2026-01-06/image/bd7455f8-ee92-4b1f-8ad8-db25308085f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/62d94082-0b63-4428-aff5-2639fc2af09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/3a1605f6-7962-4647-860b-ea0c96cb21c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/f6460c46-1301-4f2c-b4c4-06ae0991f156_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/e7dd1911-cc93-4b16-9b39-c84471956cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/122350d7-0600-49ca-bbb8-06df38f489a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/f2b4fd7b-f6ba-41d6-ade3-582a6f718066_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/5c27245d-4b9c-4e4f-b0cd-9a0178602774_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/0107c3bd-cc6b-42c5-b857-feed43379ffa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25- 8K', 'remarks': '**926** VOSA STATES 10K \t Metallic Paint\tRear View Camera, SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0f84aa32-95d5-4f9b-8772-e82234293fe9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118347430, 'registration': 'YF72ONL', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI GTE 5dr DSG', 'mileage': 10353, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 104, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-12-29', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72ONL/2026-01-06/image/bd7455f8-ee92-4b1f-8ad8-db25308085f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/62d94082-0b63-4428-aff5-2639fc2af09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/3a1605f6-7962-4647-860b-ea0c96cb21c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/f6460c46-1301-4f2c-b4c4-06ae0991f156_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/e7dd1911-cc93-4b16-9b39-c84471956cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/122350d7-0600-49ca-bbb8-06df38f489a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/f2b4fd7b-f6ba-41d6-ade3-582a6f718066_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/5c27245d-4b9c-4e4f-b0cd-9a0178602774_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72ONL/2026-01-06/image/0107c3bd-cc6b-42c5-b857-feed43379ffa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25- 8K', 'remarks': '**926** VOSA STATES 10K \t Metallic Paint\tRear View Camera, SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0f84aa32-95d5-4f9b-8772-e82234293fe9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d683e389-0cee-59e1-b494-e2adef662b09 with identifier: 118347430
2026-01-28 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d683e389-0cee-59e1-b494-e2adef662b09 with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d683e389-0cee-59e1-b494-e2adef662b09 with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d683e389-0cee-59e1-b494-e2adef662b09, identifier: 118347430
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118651836, 'registration': 'YB66XBW', 'account': 'WBA002', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 50734, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 341, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-26', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YB66XBW/2026-01-28/image/e1618628-8eb9-476a-a864-17eaf705b6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/3a38b415-252c-4b79-930a-fbc26a4f52eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/6754fae6-4d42-412a-ae6b-69e49a8a1a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/4478042d-3828-4bc0-aff5-469dca96ddf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/5d9f48d5-8ec6-4973-8a3c-be6ce69c14f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/b4c69dc4-3e7c-486f-a566-9814abe43bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/628bcc70-3006-43f1-9c0e-2a567a8b4241_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/d1d755de-cb9b-47e9-a397-8cea856319e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/66d8efc8-2be5-4345-9400-1e983ec52289_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/522f82e4-2b39-4762-b881-836efca1e7f1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 02/19-12K, 07/21-20K, 09/21-23K', 'remarks': '**526** VOSA STATES 17K, 18K, 20K, 23K, 28K, 36K, 42K, 49K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2a08aca-b14a-4657-b341-f9ec2da28685.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118651836, 'registration': 'YB66XBW', 'account': 'WBA002', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 50734, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 341, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-26', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YB66XBW/2026-01-28/image/e1618628-8eb9-476a-a864-17eaf705b6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/3a38b415-252c-4b79-930a-fbc26a4f52eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/6754fae6-4d42-412a-ae6b-69e49a8a1a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/4478042d-3828-4bc0-aff5-469dca96ddf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/5d9f48d5-8ec6-4973-8a3c-be6ce69c14f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/b4c69dc4-3e7c-486f-a566-9814abe43bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/628bcc70-3006-43f1-9c0e-2a567a8b4241_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/d1d755de-cb9b-47e9-a397-8cea856319e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/66d8efc8-2be5-4345-9400-1e983ec52289_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66XBW/2026-01-28/image/522f82e4-2b39-4762-b881-836efca1e7f1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 02/19-12K, 07/21-20K, 09/21-23K', 'remarks': '**526** VOSA STATES 17K, 18K, 20K, 23K, 28K, 36K, 42K, 49K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2a08aca-b14a-4657-b341-f9ec2da28685.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 with identifier: 118651836
2026-01-28 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5, identifier: 118651836
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117768126, 'registration': 'GX25KZW', 'account': 'LIQ001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120 M Sport 5dr Step Auto', 'mileage': 5894, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 17, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GX25KZW/2025-12-19/image/68f6bc67-2299-458e-8897-15e7abe35028_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/e55812a3-5133-4b03-993c-0d00717733c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/6cb571ff-789c-475d-93f7-64494d07da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/55a57b9c-c1a1-4214-9c2b-3ca79ba4b4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/d075e53d-aa8f-433d-9b09-c2adf24ae0e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/d960b8dd-c274-4b2f-b745-80991301e25e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/69ff1467-3cc2-4928-bc45-71aea413b1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/8fbf4953-7bb2-4a42-9f90-4f749b022448_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/c8bd1e86-7c33-4be5-8fdc-983f41d39bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/7f58387a-7551-488a-94bb-56822cb896a6_removebg.jpg?w=600'], 'colour': 'MAUVE/PURPLE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1797** SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/110d5763-b66b-4b88-bcfa-68339fb462ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117768126, 'registration': 'GX25KZW', 'account': 'LIQ001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120 M Sport 5dr Step Auto', 'mileage': 5894, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 17, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GX25KZW/2025-12-19/image/68f6bc67-2299-458e-8897-15e7abe35028_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/e55812a3-5133-4b03-993c-0d00717733c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/6cb571ff-789c-475d-93f7-64494d07da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/55a57b9c-c1a1-4214-9c2b-3ca79ba4b4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/d075e53d-aa8f-433d-9b09-c2adf24ae0e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/d960b8dd-c274-4b2f-b745-80991301e25e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/69ff1467-3cc2-4928-bc45-71aea413b1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/8fbf4953-7bb2-4a42-9f90-4f749b022448_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/c8bd1e86-7c33-4be5-8fdc-983f41d39bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX25KZW/2025-12-19/image/7f58387a-7551-488a-94bb-56822cb896a6_removebg.jpg?w=600'], 'colour': 'MAUVE/PURPLE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1797** SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/110d5763-b66b-4b88-bcfa-68339fb462ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9092dc-2ad0-5052-8180-e48779643b3b with identifier: 117768126
2026-01-28 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9092dc-2ad0-5052-8180-e48779643b3b with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9092dc-2ad0-5052-8180-e48779643b3b with scrape type 2
2026-01-28 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec9092dc-2ad0-5052-8180-e48779643b3b, identifier: 117768126
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 47449341-aae5-5b6c-9353-6cebf59b619f with identifier: 118683189
2026-01-28 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 47449341-aae5-5b6c-9353-6cebf59b619f with identifier: 118683189
2026-01-28 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 47449341-aae5-5b6c-9353-6cebf59b619f with identifier: 118683189 to the API
2026-01-28 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2747449341-aae5-5b6c-9353-6cebf59b619f%27 HTTP/1.1" 200 None
2026-01-28 19:00:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 47449341-aae5-5b6c-9353-6cebf59b619f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:52 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118683189?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 92,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '47449341-aae5-5b6c-9353-6cebf59b619f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KF72VBT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118683189',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'TOYOTA',
'model': 'YARIS HATCHBACK',
'odometer': 21240,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-12',
'seller_name': 'Arnold Limousines',
'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid Design 5dr CVT',
'transmission': 'automatic',
'trim': '1.5 Hybrid Design 5dr CVT',
'vin': None,
'year': 2023}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118683189%27 HTTP/1.1" 200 None
2026-01-28 19:00:53 [astonbarclay.gb] INFO: Saving data for 118683189: {'auction_closing_time': 1769766300.0, 'created_time': 1768503703.26114, 'last_price_update_time': 1769626853.153479}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118683189') HTTP/1.1" 204 0
2026-01-28 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d683e389-0cee-59e1-b494-e2adef662b09 with identifier: 118347430
2026-01-28 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d683e389-0cee-59e1-b494-e2adef662b09 with identifier: 118347430
2026-01-28 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d683e389-0cee-59e1-b494-e2adef662b09 with identifier: 118347430 to the API
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118347430?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 27,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': 'd683e389-0cee-59e1-b494-e2adef662b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YF72ONL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118347430',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VOLKSWAGEN',
'model': 'GOLF HATCHBACK',
'odometer': 10353,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seller_name': 'Zenith',
'title': 'VOLKSWAGEN GOLF HATCHBACK 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'vin': None,
'year': 2022}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118347430%27 HTTP/1.1" 200 None
2026-01-28 19:00:53 [astonbarclay.gb] INFO: Saving data for 118347430: {'auction_closing_time': 1769766300.0, 'created_time': 1768936633.921874, 'last_price_update_time': 1769626853.585422}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118347430') HTTP/1.1" 204 0
2026-01-28 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 with identifier: 118651836
2026-01-28 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 with identifier: 118651836
2026-01-28 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 spider: astonbarclay.gb
2026-01-28 19:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5a0bdb73-8901-52a6-beb7-b21ce580f7b5 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Diesel',
'id': '5a0bdb73-8901-52a6-beb7-b21ce580f7b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YB66XBW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118651836',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': 'X3 DIESEL ESTATE',
'odometer': 50734,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-25',
'seller_name': 'UKCGR - Premium',
'title': 'BMW X3 DIESEL ESTATE xDrive20d M Sport 5dr Step Auto',
'transmission': 'automatic',
'trim': 'xDrive20d M Sport 5dr Step Auto',
'vin': None,
'year': 2016}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118651836%27 HTTP/1.1" 200 None
2026-01-28 19:00:53 [astonbarclay.gb] INFO: Saving data for 118651836: {'auction_closing_time': 1769766300.0, 'created_time': 1768503710.376459, 'last_price_update_time': 1769626853.804444}
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118651836') HTTP/1.1" 204 0
2026-01-28 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec9092dc-2ad0-5052-8180-e48779643b3b with identifier: 117768126
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:00:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=MAUVE%2FPURPLE HTTP/1.1" 200 None
2026-01-28 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec9092dc-2ad0-5052-8180-e48779643b3b with identifier: 117768126
2026-01-28 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ec9092dc-2ad0-5052-8180-e48779643b3b with identifier: 117768126 to the API
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117768126?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'MAUVE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': 'ec9092dc-2ad0-5052-8180-e48779643b3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GX25KZW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768126',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': '1 SERIES HATCHBACK',
'odometer': 5894,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-26',
'seller_name': 'Liquid Fleet',
'title': 'BMW 1 SERIES HATCHBACK 120 M Sport 5dr Step Auto',
'transmission': 'automatic',
'trim': '120 M Sport 5dr Step Auto',
'vin': None,
'year': 2025}
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768126%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Saving data for 117768126: {'auction_closing_time': 1769766300.0, 'created_time': 1769195024.894124, 'last_price_update_time': 1769626854.336503}
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117768126') HTTP/1.1" 204 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964548
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964548%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964548: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964558
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964558%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964558: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964589
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964589%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964589: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964568
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964568%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964568: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118775439
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775439%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118775439: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964518
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964518%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964518: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 118964599
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964599%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 118964599: 0
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 119096696
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119096696%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 119096696: 1
2026-01-28 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119092570?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 119088482
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119088482%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 119088482: 1
2026-01-28 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118245988, 'registration': 'YF25LJC', 'account': 'ZEN002', 'make': 'MINI', 'model': 'ACEMAN ELECTRIC HATCHBACK', 'derivative': '135kW E Exclusive 43kWh 5dr Auto', 'mileage': 1909, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 67, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF25LJC/2026-01-13/image/30fbf982-af7a-40e5-807c-d4e981289e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/f2c50c66-0f51-41b4-bd8c-3f72ab4976d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/17adea80-f9c9-4e6f-b156-d44d12459917_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/5fcd7ebd-4f13-4ba1-89c5-b11a637b4a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/626a42c8-389f-4f39-b99a-fc37d004439f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/9e51c350-3f1f-4e15-89cb-7cde93b408e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/e6c11a67-d7de-435c-887c-4fe4ed413e7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/c907cd32-e0ed-4896-aa5e-34f3565ce278_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/6c2341e8-6caa-4dd4-a9fe-37bf1f447b6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/6573cfe8-dfbe-4d63-b517-30d4c3aa95b3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1159** SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b151bb1f-80d0-40e1-b527-125b0b6896ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118245988, 'registration': 'YF25LJC', 'account': 'ZEN002', 'make': 'MINI', 'model': 'ACEMAN ELECTRIC HATCHBACK', 'derivative': '135kW E Exclusive 43kWh 5dr Auto', 'mileage': 1909, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 67, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF25LJC/2026-01-13/image/30fbf982-af7a-40e5-807c-d4e981289e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/f2c50c66-0f51-41b4-bd8c-3f72ab4976d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/17adea80-f9c9-4e6f-b156-d44d12459917_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/5fcd7ebd-4f13-4ba1-89c5-b11a637b4a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/626a42c8-389f-4f39-b99a-fc37d004439f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/9e51c350-3f1f-4e15-89cb-7cde93b408e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/e6c11a67-d7de-435c-887c-4fe4ed413e7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/c907cd32-e0ed-4896-aa5e-34f3565ce278_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/6c2341e8-6caa-4dd4-a9fe-37bf1f447b6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF25LJC/2026-01-13/image/6573cfe8-dfbe-4d63-b517-30d4c3aa95b3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1159** SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b151bb1f-80d0-40e1-b527-125b0b6896ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37ae8457-f4d2-52e4-84ca-207ac7ec7300 with identifier: 118245988
2026-01-28 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ae8457-f4d2-52e4-84ca-207ac7ec7300 with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37ae8457-f4d2-52e4-84ca-207ac7ec7300 with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 37ae8457-f4d2-52e4-84ca-207ac7ec7300, identifier: 118245988
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118387645, 'registration': 'GU72VKG', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 13838, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 14, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-06', 'fuel': 'Electric', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VKG/2026-01-07/image/e64e05c7-70c7-4f5b-9618-bbb8d2b5f46c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/d874bfe3-aeb3-4190-badb-08514f77d4d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/34c1b541-21c6-48fe-a1d9-80b7a5d8a91e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/026c4fd9-5feb-4173-848e-2551d4732745_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/14954701-ac4d-400d-a6a6-f8bbe33113a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/f609b485-a072-4344-a5f0-2dcbe8871ee8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/f2e826dd-0e28-4eb8-b1f0-c0207a633a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/2f60e13b-c8c8-4c16-a17e-917a6a9d1ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/76d9a41a-7c7f-4ee3-a63e-0e871c54389b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 - 8K, 12/24 - 9K', 'remarks': '**228**VOSA STATES 12K Metallic - Spectral blue\t/ Leather - Black SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f37c36d-7386-4e13-80ba-d26dc9daf9cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118387645, 'registration': 'GU72VKG', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 13838, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 14, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-06', 'fuel': 'Electric', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VKG/2026-01-07/image/e64e05c7-70c7-4f5b-9618-bbb8d2b5f46c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/d874bfe3-aeb3-4190-badb-08514f77d4d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/34c1b541-21c6-48fe-a1d9-80b7a5d8a91e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/026c4fd9-5feb-4173-848e-2551d4732745_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/14954701-ac4d-400d-a6a6-f8bbe33113a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/f609b485-a072-4344-a5f0-2dcbe8871ee8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/f2e826dd-0e28-4eb8-b1f0-c0207a633a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/2f60e13b-c8c8-4c16-a17e-917a6a9d1ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VKG/2026-01-07/image/76d9a41a-7c7f-4ee3-a63e-0e871c54389b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 - 8K, 12/24 - 9K', 'remarks': '**228**VOSA STATES 12K Metallic - Spectral blue\t/ Leather - Black SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f37c36d-7386-4e13-80ba-d26dc9daf9cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f3a434-3be1-5398-9b31-d5898e2b2883 with identifier: 118387645
2026-01-28 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f3a434-3be1-5398-9b31-d5898e2b2883 with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f3a434-3be1-5398-9b31-d5898e2b2883 with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d4f3a434-3be1-5398-9b31-d5898e2b2883, identifier: 118387645
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118158100, 'registration': 'YA23PYV', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS', 'derivative': '220kW 50 Quattro 82.77kWh Edition1 5dr At C+S/Tech', 'mileage': 16002, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 76, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5932e502-4953-4d6c-9cd7-3649ec2a7cc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/247dc37d-83b0-4f08-99ff-5ea7d5b0c3f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/b3f40f0d-358a-4f9b-b839-9a96c994882c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/4324f6d7-5aca-4f38-8a4b-973a0354fc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5b348f02-73b5-4717-9e2c-e80fb5ba60ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5617ec31-1c81-415a-9cb4-452c36847218_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/7817952f-d813-4d78-b0fb-671483029370_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/bc4b42bf-03bb-40f8-a198-a3e1ec68cbee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/d2981bb1-62e5-450e-a9e4-2bd98d675006_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25- 12K', 'remarks': '**1151** Body Coloured Mirror M+ Mythos Black\tMythos Black Metallc M+ 6fg/6fa, SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3016292c-75f8-4407-8e36-ff4000131991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118158100, 'registration': 'YA23PYV', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS', 'derivative': '220kW 50 Quattro 82.77kWh Edition1 5dr At C+S/Tech', 'mileage': 16002, 'mileageWarranty': True, 'type': 'car', 'saleId': 18036, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 76, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5932e502-4953-4d6c-9cd7-3649ec2a7cc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/247dc37d-83b0-4f08-99ff-5ea7d5b0c3f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/b3f40f0d-358a-4f9b-b839-9a96c994882c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/4324f6d7-5aca-4f38-8a4b-973a0354fc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5b348f02-73b5-4717-9e2c-e80fb5ba60ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/5617ec31-1c81-415a-9cb4-452c36847218_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/7817952f-d813-4d78-b0fb-671483029370_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/bc4b42bf-03bb-40f8-a198-a3e1ec68cbee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA23PYV/2026-01-13/image/d2981bb1-62e5-450e-a9e4-2bd98d675006_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25- 12K', 'remarks': '**1151** Body Coloured Mirror M+ Mythos Black\tMythos Black Metallc M+ 6fg/6fa, SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3016292c-75f8-4407-8e36-ff4000131991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978f88b5-79f6-518c-9a3a-c54e4104867e with identifier: 118158100
2026-01-28 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978f88b5-79f6-518c-9a3a-c54e4104867e with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978f88b5-79f6-518c-9a3a-c54e4104867e with scrape type 2
2026-01-28 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 978f88b5-79f6-518c-9a3a-c54e4104867e, identifier: 118158100
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 119097501
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097501%27 HTTP/1.1" 200 None
2026-01-28 19:00:54 [astonbarclay.gb] INFO: Scrape type for 119097501: 1
2026-01-28 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 37ae8457-f4d2-52e4-84ca-207ac7ec7300 with identifier: 118245988
2026-01-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 37ae8457-f4d2-52e4-84ca-207ac7ec7300 with identifier: 118245988
2026-01-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mini aceman electric hatchback 135kw e exclusive 43kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'aceman electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1909, 'odometer_reading_unit': 'mi', 'registration_date': '2025-07-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118245988', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '135kw e exclusive 43kwh 5dr auto', 'license_plate': 'yf25ljc', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '37ae8457-f4d2-52e4-84ca-207ac7ec7300', 'current_year_diff': 1, 'age_in_months': 6, 'make_model': 'mini aceman electric hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 3072} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 6,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '37ae8457-f4d2-52e4-84ca-207ac7ec7300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yf25ljc',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118245988',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mini',
'make_model': 'mini aceman electric hatchback',
'model': 'aceman electric hatchback',
'odometer': 1909,
'odometer_in_km': 3072,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-18',
'sanitized_make': 'mini',
'seller_name': 'zenith',
'title': 'mini aceman electric hatchback 135kw e exclusive 43kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '135kw e exclusive 43kwh 5dr auto',
'vin': None,
'year': 2025}
2026-01-28 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 37ae8457-f4d2-52e4-84ca-207ac7ec7300 spider: astonbarclay.gb
2026-01-28 19:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 37ae8457-f4d2-52e4-84ca-207ac7ec7300 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mini aceman electric hatchback 135kw e exclusive 43kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'aceman electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1909, 'odometer_reading_unit': 'mi', 'registration_date': '2025-07-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118245988', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '135kw e exclusive 43kwh 5dr auto', 'license_plate': 'yf25ljc', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '37ae8457-f4d2-52e4-84ca-207ac7ec7300', 'current_year_diff': 1, 'age_in_months': 6, 'make_model': 'mini aceman electric hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 3072} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 6,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '37ae8457-f4d2-52e4-84ca-207ac7ec7300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yf25ljc',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118245988',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mini',
'make_model': 'mini aceman electric hatchback',
'model': 'aceman electric hatchback',
'odometer': 1909,
'odometer_in_km': 3072,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-18',
'sanitized_make': 'mini',
'seller_name': 'zenith',
'title': 'mini aceman electric hatchback 135kw e exclusive 43kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '135kw e exclusive 43kwh 5dr auto',
'vin': None,
'year': 2025}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Electric',
'id': '37ae8457-f4d2-52e4-84ca-207ac7ec7300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YF25LJC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118245988',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MINI',
'model': 'ACEMAN ELECTRIC HATCHBACK',
'odometer': 1909,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-18',
'seller_name': 'Zenith',
'title': 'MINI ACEMAN ELECTRIC HATCHBACK 135kW E Exclusive 43kWh 5dr Auto',
'transmission': 'automatic',
'trim': '135kW E Exclusive 43kWh 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118245988%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Saving data for 118245988: {'auction_closing_time': 1769766300.0, 'created_time': 1768936318.536333, 'last_price_update_time': 1769626855.053489}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118245988') HTTP/1.1" 204 0
2026-01-28 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d4f3a434-3be1-5398-9b31-d5898e2b2883 with identifier: 118387645
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d4f3a434-3be1-5398-9b31-d5898e2b2883 with identifier: 118387645
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 13838, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-06', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118387645', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vkg', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd4f3a434-3be1-5398-9b31-d5898e2b2883', 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 22270} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': 'd4f3a434-3be1-5398-9b31-d5898e2b2883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vkg',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118387645',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 13838,
'odometer_in_km': 22270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d4f3a434-3be1-5398-9b31-d5898e2b2883 spider: astonbarclay.gb
2026-01-28 19:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d4f3a434-3be1-5398-9b31-d5898e2b2883 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 13838, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-06', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118387645', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vkg', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd4f3a434-3be1-5398-9b31-d5898e2b2883', 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 22270} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': 'd4f3a434-3be1-5398-9b31-d5898e2b2883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vkg',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118387645',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 13838,
'odometer_in_km': 22270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Electric',
'id': 'd4f3a434-3be1-5398-9b31-d5898e2b2883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GU72VKG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118387645',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MERCEDES-BENZ',
'model': 'EQC ESTATE',
'odometer': 13838,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'seller_name': 'Kinto',
'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118387645%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Saving data for 118387645: {'auction_closing_time': 1769766300.0, 'created_time': 1768504024.910362, 'last_price_update_time': 1769626855.272483}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118387645') HTTP/1.1" 204 0
2026-01-28 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 978f88b5-79f6-518c-9a3a-c54e4104867e with identifier: 118158100
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 978f88b5-79f6-518c-9a3a-c54e4104867e with identifier: 118158100
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback special editions 220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16002, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118158100', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech', 'license_plate': 'ya23pyv', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '978f88b5-79f6-518c-9a3a-c54e4104867e', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'audi q4 e-tron sportback special editions', 'sanitized_make': 'audi', 'odometer_in_km': 25752} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '978f88b5-79f6-518c-9a3a-c54e4104867e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ya23pyv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118158100',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'audi',
'make_model': 'audi q4 e-tron sportback special editions',
'model': 'q4 e-tron sportback special editions',
'odometer': 16002,
'odometer_in_km': 25752,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'sanitized_make': 'audi',
'seller_name': 'zenith',
'title': 'audi q4 e-tron sportback special editions 220kw 50 quattro '
'82.77kwh edition1 5dr at c+s/tech',
'transmission': 'automatic',
'trim': '220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech',
'vin': None,
'year': 2023}
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 978f88b5-79f6-518c-9a3a-c54e4104867e spider: astonbarclay.gb
2026-01-28 19:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 978f88b5-79f6-518c-9a3a-c54e4104867e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback special editions 220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16002, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118158100', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech', 'license_plate': 'ya23pyv', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '978f88b5-79f6-518c-9a3a-c54e4104867e', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'audi q4 e-tron sportback special editions', 'sanitized_make': 'audi', 'odometer_in_km': 25752} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '978f88b5-79f6-518c-9a3a-c54e4104867e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ya23pyv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118158100',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'audi',
'make_model': 'audi q4 e-tron sportback special editions',
'model': 'q4 e-tron sportback special editions',
'odometer': 16002,
'odometer_in_km': 25752,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'sanitized_make': 'audi',
'seller_name': 'zenith',
'title': 'audi q4 e-tron sportback special editions 220kw 50 quattro '
'82.77kwh edition1 5dr at c+s/tech',
'transmission': 'automatic',
'trim': '220kw 50 quattro 82.77kwh edition1 5dr at c+s/tech',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Electric',
'id': '978f88b5-79f6-518c-9a3a-c54e4104867e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YA23PYV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118158100',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'AUDI',
'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS',
'odometer': 16002,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seller_name': 'Zenith',
'title': 'AUDI Q4 E-TRON SPORTBACK SPECIAL EDITIONS 220kW 50 Quattro 82.77kWh '
'Edition1 5dr At C+S/Tech',
'transmission': 'automatic',
'trim': '220kW 50 Quattro 82.77kWh Edition1 5dr At C+S/Tech',
'vin': None,
'year': 2023}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118158100%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Saving data for 118158100: {'auction_closing_time': 1769766300.0, 'created_time': 1768936044.076018, 'last_price_update_time': 1769626855.493653}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118158100') HTTP/1.1" 204 0
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 119063729
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119063729%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Scrape type for 119063729: 1
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119092570, 'registration': 'LG70PDU', 'account': 'CAR001', 'make': 'AUDI', 'model': 'E-TRON ESTATE', 'derivative': '230kW 50 Quattro 71kWh Technik 5dr Auto', 'mileage': 29493, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-17', 'fuel': 'Electric', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES, 21K, 24K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/64a7f4b9-359b-4aaa-98a2-38ad9eb7fb65.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119092570, 'registration': 'LG70PDU', 'account': 'CAR001', 'make': 'AUDI', 'model': 'E-TRON ESTATE', 'derivative': '230kW 50 Quattro 71kWh Technik 5dr Auto', 'mileage': 29493, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-17', 'fuel': 'Electric', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES, 21K, 24K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/64a7f4b9-359b-4aaa-98a2-38ad9eb7fb65.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 with identifier: 119092570
2026-01-28 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 with scrape type 1
2026-01-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2
2026-01-28 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2
2026-01-28 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2, identifier: 119092570
2026-01-28 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 with identifier: 119092570
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 with identifier: 119092570
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'audi e-tron estate 230kw 50 quattro 71kwh technik 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 29493, 'odometer_reading_unit': 'mi', 'registration_date': '2020-09-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092570', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '230kw 50 quattro 71kwh technik 5dr auto', 'license_plate': 'lg70pdu', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'audi e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 47464} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'electric',
'id': '61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lg70pdu',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092570',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'audi',
'make_model': 'audi e-tron estate',
'model': 'e-tron estate',
'odometer': 29493,
'odometer_in_km': 47464,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'sanitized_make': 'audi',
'seller_name': 'cargiant',
'title': 'audi e-tron estate 230kw 50 quattro 71kwh technik 5dr auto',
'transmission': 'automatic',
'trim': '230kw 50 quattro 71kwh technik 5dr auto',
'vin': None,
'year': 2020}
2026-01-28 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 spider: astonbarclay.gb
2026-01-28 19:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'audi e-tron estate 230kw 50 quattro 71kwh technik 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 29493, 'odometer_reading_unit': 'mi', 'registration_date': '2020-09-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092570', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '230kw 50 quattro 71kwh technik 5dr auto', 'license_plate': 'lg70pdu', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'audi e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 47464} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'electric',
'id': '61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lg70pdu',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092570',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'audi',
'make_model': 'audi e-tron estate',
'model': 'e-tron estate',
'odometer': 29493,
'odometer_in_km': 47464,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'sanitized_make': 'audi',
'seller_name': 'cargiant',
'title': 'audi e-tron estate 230kw 50 quattro 71kwh technik 5dr auto',
'transmission': 'automatic',
'trim': '230kw 50 quattro 71kwh technik 5dr auto',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Electric',
'id': '61b8f3d0-7cf1-5b31-9b5c-a3b13f9281b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LG70PDU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092570',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'AUDI',
'model': 'E-TRON ESTATE',
'odometer': 29493,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seller_name': 'CarGiant',
'title': 'AUDI E-TRON ESTATE 230kW 50 Quattro 71kWh Technik 5dr Auto',
'transmission': 'automatic',
'trim': '230kW 50 Quattro 71kWh Technik 5dr Auto',
'vin': None,
'year': 2020}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119092570%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Saving data for 119092570: {'created_time': 1769626855.846157, 'last_price_update_time': 1769626855.846168, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119092570') HTTP/1.1" 204 0
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 119056636
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119056636%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Scrape type for 119056636: 0
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 119016033
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119016033%27 HTTP/1.1" 200 None
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Scrape type for 119016033: 2
2026-01-28 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 118775449
2026-01-28 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775449%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118775449: 2
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118556340
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118556340%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118556340: 2
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118748135
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118748135%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118748135: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119063131
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119063131%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119063131: 1
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119033296
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033296%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119033296: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119060462
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060462%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119060462: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118917131
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118917131%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118917131: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119061079
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119061079%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119061079: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118964578
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964578%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118964578: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119097348
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097348%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119097348: 1
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119015906
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119015906%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119015906: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118775480
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775480%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118775480: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118556355
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118556355%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118556355: 2
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119097246
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097246%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119097246: 1
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119053592?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119045738?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118990250
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990250%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118990250: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118137730
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137730%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118137730: 1
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118485440?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119046641
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119046641%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119046641: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118950911
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950911%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118950911: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118976866
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118976866%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118976866: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118989697
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989697%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118989697: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118983790
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118983790%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118983790: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119050471
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119050471%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119050471: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119050728
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119050728%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119050728: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118331157
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118331157%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118331157: 1
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119097670?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119097002?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119034796
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034796%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119034796: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119061760
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119061760%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119061760: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118964528
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964528%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118964528: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118923299
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923299%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118923299: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118775460
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775460%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118775460: 2
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119079251?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119053592, 'registration': 'DT65GUJ', 'account': 'WBA004', 'make': 'VAUXHALL', 'model': 'INSIGNIA HATCHBACK', 'derivative': '1.4T Design Nav 5dr [Start Stop]', 'mileage': 134970, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90534422-a370-48b7-947f-05d07ab4d2c5.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119053592, 'registration': 'DT65GUJ', 'account': 'WBA004', 'make': 'VAUXHALL', 'model': 'INSIGNIA HATCHBACK', 'derivative': '1.4T Design Nav 5dr [Start Stop]', 'mileage': 134970, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90534422-a370-48b7-947f-05d07ab4d2c5.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53cbe981-1a94-5c00-a50d-d5652f7d242c with identifier: 119053592
2026-01-28 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53cbe981-1a94-5c00-a50d-d5652f7d242c with scrape type 1
2026-01-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 53cbe981-1a94-5c00-a50d-d5652f7d242c
2026-01-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 53cbe981-1a94-5c00-a50d-d5652f7d242c
2026-01-28 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53cbe981-1a94-5c00-a50d-d5652f7d242c, identifier: 119053592
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119045738, 'registration': 'KF16HYR', 'account': 'WBA003', 'make': 'RENAULT', 'model': 'CLIO DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Dynamique Nav 5dr Auto', 'mileage': 23670, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-06-25', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bdd340eb-cc6a-44e7-9534-6a1b65c62788.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119045738, 'registration': 'KF16HYR', 'account': 'WBA003', 'make': 'RENAULT', 'model': 'CLIO DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Dynamique Nav 5dr Auto', 'mileage': 23670, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-06-25', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bdd340eb-cc6a-44e7-9534-6a1b65c62788.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c53b2a25-9580-56b7-a597-af6c73d1d7f5 with identifier: 119045738
2026-01-28 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53b2a25-9580-56b7-a597-af6c73d1d7f5 with scrape type 1
2026-01-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c53b2a25-9580-56b7-a597-af6c73d1d7f5
2026-01-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c53b2a25-9580-56b7-a597-af6c73d1d7f5
2026-01-28 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c53b2a25-9580-56b7-a597-af6c73d1d7f5, identifier: 119045738
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118485440, 'registration': 'LB66LZU', 'account': 'WBA003', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Prime Premium 2dr Auto', 'mileage': 93205, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-02', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/LB66LZU/2026-01-12/image/8eac53fb-7b62-4645-b401-d11a15edad75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/105f5824-aa47-4aed-bb54-b3a494c00df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/83a0693c-d530-448c-996e-be093cef79a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/6bb68be3-8f76-40d2-b73c-68c9d2fbbae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/fb7d2711-3903-45cd-a98f-9f69b5729139_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/2c56355f-f47a-4e25-863d-1ab46c618374_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/a8356803-9e38-4d23-a765-c3081abea96a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/0832d924-f2ad-4134-8e09-650724966a88_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/18 11K - 02/19 22K - 03/20 31K - 05/22 48K - 08/23 61K', 'remarks': 'VOSA STATES - 40K - 49K - 60K - 73K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/547944b5-35b3-4791-8304-bd23713bfdf8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118485440, 'registration': 'LB66LZU', 'account': 'WBA003', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Prime Premium 2dr Auto', 'mileage': 93205, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-02', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/LB66LZU/2026-01-12/image/8eac53fb-7b62-4645-b401-d11a15edad75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/105f5824-aa47-4aed-bb54-b3a494c00df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/83a0693c-d530-448c-996e-be093cef79a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/6bb68be3-8f76-40d2-b73c-68c9d2fbbae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/fb7d2711-3903-45cd-a98f-9f69b5729139_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/2c56355f-f47a-4e25-863d-1ab46c618374_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/a8356803-9e38-4d23-a765-c3081abea96a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66LZU/2026-01-12/image/0832d924-f2ad-4134-8e09-650724966a88_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/18 11K - 02/19 22K - 03/20 31K - 05/22 48K - 08/23 61K', 'remarks': 'VOSA STATES - 40K - 49K - 60K - 73K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/547944b5-35b3-4791-8304-bd23713bfdf8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59b5d54-53e1-524d-be37-fcd3d91ff6d9 with identifier: 118485440
2026-01-28 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59b5d54-53e1-524d-be37-fcd3d91ff6d9 with scrape type 2
2026-01-28 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59b5d54-53e1-524d-be37-fcd3d91ff6d9 with scrape type 2
2026-01-28 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e59b5d54-53e1-524d-be37-fcd3d91ff6d9, identifier: 118485440
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 118945612
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118945612%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 118945612: 0
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 119099408
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099408%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Scrape type for 119099408: 1
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53cbe981-1a94-5c00-a50d-d5652f7d242c with identifier: 119053592
2026-01-28 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53cbe981-1a94-5c00-a50d-d5652f7d242c with identifier: 119053592
2026-01-28 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'vauxhall insignia hatchback 1.4t design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 134970, 'odometer_reading_unit': 'mi', 'registration_date': '2016-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053592', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4t design nav 5dr [start stop]', 'license_plate': 'dt65guj', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 129, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '53cbe981-1a94-5c00-a50d-d5652f7d242c', 'current_year_diff': 10, 'age_in_months': 119, 'make_model': 'vauxhall insignia hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 217212}
Failed validating None in schema:
False
On instance:
{'age_in_months': 119,
'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.4l',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'petrol',
'id': '53cbe981-1a94-5c00-a50d-d5652f7d242c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'dt65guj',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053592',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'vauxhall',
'make_model': 'vauxhall insignia hatchback',
'model': 'insignia hatchback',
'odometer': 134970,
'odometer_in_km': 217212,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'sanitized_make': 'vauxhall',
'seller_name': 'ukcgr - trade',
'title': 'vauxhall insignia hatchback 1.4t design nav 5dr [start '
'stop]',
'transmission': 'manual',
'trim': '1.4t design nav 5dr [start stop]',
'vin': None,
'year': 2016}
2026-01-28 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 53cbe981-1a94-5c00-a50d-d5652f7d242c spider: astonbarclay.gb
2026-01-28 19:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 53cbe981-1a94-5c00-a50d-d5652f7d242c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'vauxhall insignia hatchback 1.4t design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 134970, 'odometer_reading_unit': 'mi', 'registration_date': '2016-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053592', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4t design nav 5dr [start stop]', 'license_plate': 'dt65guj', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 129, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '53cbe981-1a94-5c00-a50d-d5652f7d242c', 'current_year_diff': 10, 'age_in_months': 119, 'make_model': 'vauxhall insignia hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 217212}
Failed validating None in schema:
False
On instance:
{'age_in_months': 119,
'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.4l',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'petrol',
'id': '53cbe981-1a94-5c00-a50d-d5652f7d242c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'dt65guj',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053592',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'vauxhall',
'make_model': 'vauxhall insignia hatchback',
'model': 'insignia hatchback',
'odometer': 134970,
'odometer_in_km': 217212,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'sanitized_make': 'vauxhall',
'seller_name': 'ukcgr - trade',
'title': 'vauxhall insignia hatchback 1.4t design nav 5dr [start '
'stop]',
'transmission': 'manual',
'trim': '1.4t design nav 5dr [start stop]',
'vin': None,
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': '53cbe981-1a94-5c00-a50d-d5652f7d242c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DT65GUJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053592',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'INSIGNIA HATCHBACK',
'odometer': 134970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': 'UKCGR - Trade',
'title': 'VAUXHALL INSIGNIA HATCHBACK 1.4T Design Nav 5dr [Start Stop]',
'transmission': 'manual',
'trim': '1.4T Design Nav 5dr [Start Stop]',
'vin': None,
'year': 2016}
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053592%27 HTTP/1.1" 200 None
2026-01-28 19:00:56 [astonbarclay.gb] INFO: Saving data for 119053592: {'created_time': 1769626856.971242, 'last_price_update_time': 1769626856.971252, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119053592') HTTP/1.1" 204 0
2026-01-28 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c53b2a25-9580-56b7-a597-af6c73d1d7f5 with identifier: 119045738
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c53b2a25-9580-56b7-a597-af6c73d1d7f5 with identifier: 119045738
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: c53b2a25-9580-56b7-a597-af6c73d1d7f5 spider: astonbarclay.gb
2026-01-28 19:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c53b2a25-9580-56b7-a597-af6c73d1d7f5 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 92,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Diesel',
'id': 'c53b2a25-9580-56b7-a597-af6c73d1d7f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KF16HYR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119045738',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'RENAULT',
'model': 'CLIO DIESEL HATCHBACK',
'odometer': 23670,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-22',
'seller_name': 'UKCGR - Select',
'title': 'RENAULT CLIO DIESEL HATCHBACK 1.5 dCi 90 Dynamique Nav 5dr Auto',
'transmission': 'automatic',
'trim': '1.5 dCi 90 Dynamique Nav 5dr Auto',
'vin': None,
'year': 2016}
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045738%27 HTTP/1.1" 200 None
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Saving data for 119045738: {'created_time': 1769626857.283306, 'last_price_update_time': 1769626857.283317, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119045738') HTTP/1.1" 204 0
2026-01-28 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e59b5d54-53e1-524d-be37-fcd3d91ff6d9 with identifier: 118485440
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e59b5d54-53e1-524d-be37-fcd3d91ff6d9 with identifier: 118485440
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: e59b5d54-53e1-524d-be37-fcd3d91ff6d9 spider: astonbarclay.gb
2026-01-28 19:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e59b5d54-53e1-524d-be37-fcd3d91ff6d9 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': 'e59b5d54-53e1-524d-be37-fcd3d91ff6d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LB66LZU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118485440',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'SMART',
'model': 'FORTWO COUPE',
'odometer': 93205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-30',
'seller_name': 'UKCGR - Select',
'title': 'SMART FORTWO COUPE 1.0 Prime Premium 2dr Auto',
'transmission': 'automatic',
'trim': '1.0 Prime Premium 2dr Auto',
'vin': None,
'year': 2016}
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118485440%27 HTTP/1.1" 200 None
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Saving data for 118485440: {'auction_closing_time': 1770053400.0, 'created_time': 1768244659.251921, 'last_price_update_time': 1769626857.492685}
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118485440') HTTP/1.1" 204 0
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 119075537
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119075537%27 HTTP/1.1" 200 None
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Scrape type for 119075537: 1
2026-01-28 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118776960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119097670, 'registration': 'MT17ULC', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 45494, 'mileageWarranty': False, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 5/18 9K, 5/19 19K, 6/20 22K, 6/21 26K, 11/24 36K, 12/25 41K', 'remarks': 'VOSA STATES 32K, 35K, 40K, 44K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc64e417-2e7f-47c9-8dc6-2684acd3ba7c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119097670, 'registration': 'MT17ULC', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 45494, 'mileageWarranty': False, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 5/18 9K, 5/19 19K, 6/20 22K, 6/21 26K, 11/24 36K, 12/25 41K', 'remarks': 'VOSA STATES 32K, 35K, 40K, 44K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc64e417-2e7f-47c9-8dc6-2684acd3ba7c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc607a0d-3227-57a5-82d0-cdc5ba8cbcca with identifier: 119097670
2026-01-28 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc607a0d-3227-57a5-82d0-cdc5ba8cbcca with scrape type 1
2026-01-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item dc607a0d-3227-57a5-82d0-cdc5ba8cbcca
2026-01-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item dc607a0d-3227-57a5-82d0-cdc5ba8cbcca
2026-01-28 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dc607a0d-3227-57a5-82d0-cdc5ba8cbcca, identifier: 119097670
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119097002, 'registration': 'DU69LLV', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.3 DiG-T Tekna 5dr DCT', 'mileage': 106457, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-24', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83431b53-c95a-40ba-8ba4-370b2aa172af.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119097002, 'registration': 'DU69LLV', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.3 DiG-T Tekna 5dr DCT', 'mileage': 106457, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-24', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83431b53-c95a-40ba-8ba4-370b2aa172af.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae66b22a-2e5c-5930-bb55-7ddb3044604f with identifier: 119097002
2026-01-28 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae66b22a-2e5c-5930-bb55-7ddb3044604f with scrape type 1
2026-01-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ae66b22a-2e5c-5930-bb55-7ddb3044604f
2026-01-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ae66b22a-2e5c-5930-bb55-7ddb3044604f
2026-01-28 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ae66b22a-2e5c-5930-bb55-7ddb3044604f, identifier: 119097002
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119091175, 'registration': 'WV18UVB', 'account': 'CAR001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 SRi Vx-line 5dr', 'mileage': 75498, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Petrol', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c31e-4b66-44d5-bb6c-280853c35fe8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119091175, 'registration': 'WV18UVB', 'account': 'CAR001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 SRi Vx-line 5dr', 'mileage': 75498, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Petrol', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c31e-4b66-44d5-bb6c-280853c35fe8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f2638d-528a-5989-b49b-901759dfca90 with identifier: 119091175
2026-01-28 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f2638d-528a-5989-b49b-901759dfca90 with scrape type 1
2026-01-28 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fb93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119079251, 'registration': 'PG17FTX', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES DIESEL SALOON', 'derivative': '320d Sport 4dr Step Auto', 'mileage': 67174, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-10', 'fuel': 'Diesel', 'motExpiry': '2026-03-21', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2dfde1db-2e15-4fa8-bb49-347ff1658dbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119079251, 'registration': 'PG17FTX', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES DIESEL SALOON', 'derivative': '320d Sport 4dr Step Auto', 'mileage': 67174, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-10', 'fuel': 'Diesel', 'motExpiry': '2026-03-21', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2dfde1db-2e15-4fa8-bb49-347ff1658dbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c69c1d-a2d5-5257-8163-a351b760ab73 with identifier: 119079251
2026-01-28 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c69c1d-a2d5-5257-8163-a351b760ab73 with scrape type 1
2026-01-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a0c69c1d-a2d5-5257-8163-a351b760ab73
2026-01-28 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a0c69c1d-a2d5-5257-8163-a351b760ab73
2026-01-28 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a0c69c1d-a2d5-5257-8163-a351b760ab73, identifier: 119079251
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 118986783
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118986783%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Scrape type for 118986783: 0
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 118964538
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964538%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Scrape type for 118964538: 0
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 119061044
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119061044%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Scrape type for 119061044: 0
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 119086318
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119086318%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Scrape type for 119086318: 1
2026-01-28 19:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dc607a0d-3227-57a5-82d0-cdc5ba8cbcca with identifier: 119097670
2026-01-28 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dc607a0d-3227-57a5-82d0-cdc5ba8cbcca with identifier: 119097670
2026-01-28 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dc607a0d-3227-57a5-82d0-cdc5ba8cbcca with identifier: 119097670 to the API
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27dc607a0d-3227-57a5-82d0-cdc5ba8cbcca%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id dc607a0d-3227-57a5-82d0-cdc5ba8cbcca: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119097670?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': 'dc607a0d-3227-57a5-82d0-cdc5ba8cbcca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MT17ULC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119097670',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'CITROEN',
'model': 'C1 HATCHBACK',
'odometer': 45494,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-28',
'seller_name': 'Manamanx Ltd',
'title': 'CITROEN C1 HATCHBACK 1.2 PureTech Flair 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Flair 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097670%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Saving data for 119097670: {'created_time': 1769626858.768797, 'last_price_update_time': 1769626858.768807, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119097670') HTTP/1.1" 204 0
2026-01-28 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ae66b22a-2e5c-5930-bb55-7ddb3044604f with identifier: 119097002
2026-01-28 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ae66b22a-2e5c-5930-bb55-7ddb3044604f with identifier: 119097002
2026-01-28 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171325 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171325
2026-01-28 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ae66b22a-2e5c-5930-bb55-7ddb3044604f spider: astonbarclay.gb
2026-01-28 19:00:58 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ae66b22a-2e5c-5930-bb55-7ddb3044604f due to rule: high_mileage_for_country.json, error: 171325 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171325
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': 'ae66b22a-2e5c-5930-bb55-7ddb3044604f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DU69LLV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119097002',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'X-TRAIL STATION WAGON',
'odometer': 106457,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seller_name': 'CarGiant',
'title': 'NISSAN X-TRAIL STATION WAGON 1.3 DiG-T Tekna 5dr DCT',
'transmission': 'automatic',
'trim': '1.3 DiG-T Tekna 5dr DCT',
'vin': None,
'year': 2019}
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097002%27 HTTP/1.1" 200 None
2026-01-28 19:00:58 [astonbarclay.gb] INFO: Saving data for 119097002: {'created_time': 1769626858.997224, 'last_price_update_time': 1769626858.997234, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119097002') HTTP/1.1" 204 0
2026-01-28 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a0c69c1d-a2d5-5257-8163-a351b760ab73 with identifier: 119079251
2026-01-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a0c69c1d-a2d5-5257-8163-a351b760ab73 with identifier: 119079251
2026-01-28 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a0c69c1d-a2d5-5257-8163-a351b760ab73 with identifier: 119079251 to the API
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a0c69c1d-a2d5-5257-8163-a351b760ab73%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a0c69c1d-a2d5-5257-8163-a351b760ab73: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:00:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119079251?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Diesel',
'id': 'a0c69c1d-a2d5-5257-8163-a351b760ab73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'PG17FTX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119079251',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'BMW',
'model': '3 SERIES DIESEL SALOON',
'odometer': 67174,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-10',
'seller_name': 'CarGiant',
'title': 'BMW 3 SERIES DIESEL SALOON 320d Sport 4dr Step Auto',
'transmission': 'automatic',
'trim': '320d Sport 4dr Step Auto',
'vin': None,
'year': 2017}
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119079251%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Saving data for 119079251: {'created_time': 1769626859.298267, 'last_price_update_time': 1769626859.298278, 'auction_closing_time': 1770053400.0}
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119079251') HTTP/1.1" 204 0
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fc31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 119037259
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037259%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 119037259: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118989432
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989432%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118989432: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 119036920
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036920%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 119036920: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118603823
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118603823%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118603823: 2
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118776960, 'registration': 'DE16TXT', 'account': 'HEN022', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX5hs 5dr Auto', 'mileage': 108296, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE16TXT/2026-01-22/image/8bb029fb-8adb-4ad2-ae41-adaa710ef473_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/7179c467-ad34-430c-811c-54eca16fb5f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/a05d7785-2579-4d72-946d-23e97daba173_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/910e6913-60d9-4617-8c2f-b98327a58363_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/8db0c759-0d5e-4bae-8129-5ee894ae51bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/1f85d074-3ec7-4911-a8a0-90052ba28951_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/af86aabe-a668-47c4-ae0e-c6b727a6b452_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/87448b61-a5a0-41a7-aabf-2eb9be5485dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/76004548-5d6d-4bf1-a5d6-2ccf3bb4baa9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17-7K 07/18-12K 04/19-15K 05/20-21K 05/21-28K 05/22-44K 05/23-63K 05/24-80K 05/25-98K', 'remarks': 'SPARE KEY VOSA STATES 15K 21K 28K 44K 63K 80K 98K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2910d480-b563-4535-b38b-f4ba4370c68e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118776960, 'registration': 'DE16TXT', 'account': 'HEN022', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX5hs 5dr Auto', 'mileage': 108296, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE16TXT/2026-01-22/image/8bb029fb-8adb-4ad2-ae41-adaa710ef473_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/7179c467-ad34-430c-811c-54eca16fb5f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/a05d7785-2579-4d72-946d-23e97daba173_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/910e6913-60d9-4617-8c2f-b98327a58363_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/8db0c759-0d5e-4bae-8129-5ee894ae51bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/1f85d074-3ec7-4911-a8a0-90052ba28951_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/af86aabe-a668-47c4-ae0e-c6b727a6b452_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/87448b61-a5a0-41a7-aabf-2eb9be5485dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16TXT/2026-01-22/image/76004548-5d6d-4bf1-a5d6-2ccf3bb4baa9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17-7K 07/18-12K 04/19-15K 05/20-21K 05/21-28K 05/22-44K 05/23-63K 05/24-80K 05/25-98K', 'remarks': 'SPARE KEY VOSA STATES 15K 21K 28K 44K 63K 80K 98K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2910d480-b563-4535-b38b-f4ba4370c68e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663ceccd-56d1-5665-8067-02784e423390 with identifier: 118776960
2026-01-28 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663ceccd-56d1-5665-8067-02784e423390 with scrape type 2
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 663ceccd-56d1-5665-8067-02784e423390 with scrape type 2
2026-01-28 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 663ceccd-56d1-5665-8067-02784e423390, identifier: 118776960
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 663ceccd-56d1-5665-8067-02784e423390 with identifier: 118776960
2026-01-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 663ceccd-56d1-5665-8067-02784e423390 with identifier: 118776960
2026-01-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174285 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174285
2026-01-28 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 663ceccd-56d1-5665-8067-02784e423390 spider: astonbarclay.gb
2026-01-28 19:00:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 663ceccd-56d1-5665-8067-02784e423390 due to rule: high_mileage_for_country.json, error: 174285 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174285
{'auction_title': '',
'c_o_2_emission_value': 42,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '663ceccd-56d1-5665-8067-02784e423390',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DE16TXT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118776960',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'MITSUBISHI',
'model': 'OUTLANDER ESTATE',
'odometer': 108296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seller_name': 'Car360',
'title': 'MITSUBISHI OUTLANDER ESTATE 2.0 PHEV GX5hs 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 PHEV GX5hs 5dr Auto',
'vin': None,
'year': 2016}
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118776960%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Saving data for 118776960: {'auction_closing_time': 1769774400.0, 'created_time': 1769108564.502645, 'last_price_update_time': 1769626859.729753}
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118776960') HTTP/1.1" 204 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118751075
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118751075%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118751075: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117780903
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117780903%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117780903: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118576221
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118576221%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118576221: 2
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fbb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118888652
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118888652%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118888652: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118974105
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974105%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118974105: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118948660
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948660%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118948660: 2
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 119019703
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119019703%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 119019703: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118972685
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118972685%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118972685: 0
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118804823
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118804823%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118804823: 2
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118585498
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118585498%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Scrape type for 118585498: 2
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 118577925
2026-01-28 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118577925%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118577925: 0
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118571721
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118571721%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118571721: 2
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118956491
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118956491%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118956491: 2
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118948936
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948936%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118948936: 2
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118601267
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118601267%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118601267: 2
2026-01-28 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118778553
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118778553%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118778553: 2
2026-01-28 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118822182
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118822182%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118822182: 2
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118527971
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118527971%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118527971: 2
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118604329
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118604329%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118604329: 2
2026-01-28 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119098627?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119089043, 'registration': 'DS72FKL', 'account': 'MOT070', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 22008, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-12-20', 'fuel': 'Petrol', 'motExpiry': '2026-12-19', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 21k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b42df09-bfcd-4f4f-a39e-8f33e14bdef7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119089043, 'registration': 'DS72FKL', 'account': 'MOT070', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 22008, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-12-20', 'fuel': 'Petrol', 'motExpiry': '2026-12-19', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 21k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b42df09-bfcd-4f4f-a39e-8f33e14bdef7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with identifier: 119089043
2026-01-28 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with scrape type 1
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118688338
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118688338%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118688338: 2
2026-01-28 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117164114: 2
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118955034
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118955034%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118955034: 2
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118360675
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118360675%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118360675: 2
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 118379658
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118379658%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Scrape type for 118379658: 2
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119098627, 'registration': 'DV17OUA', 'account': 'QUO001', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr', 'mileage': 85797, 'mileageWarranty': False, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 33K 54K 56K 88K 80K MILEAGE DISCREPANCY ON VOSA', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55d1a328-a727-4412-983c-5bc3b53271ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119098627, 'registration': 'DV17OUA', 'account': 'QUO001', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr', 'mileage': 85797, 'mileageWarranty': False, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 33K 54K 56K 88K 80K MILEAGE DISCREPANCY ON VOSA', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55d1a328-a727-4412-983c-5bc3b53271ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ece578-2949-564a-8b35-079dd67de311 with identifier: 119098627
2026-01-28 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ece578-2949-564a-8b35-079dd67de311 with scrape type 1
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 15ece578-2949-564a-8b35-079dd67de311
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 15ece578-2949-564a-8b35-079dd67de311
2026-01-28 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 15ece578-2949-564a-8b35-079dd67de311, identifier: 119098627
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252Fbfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 15ece578-2949-564a-8b35-079dd67de311 with identifier: 119098627
2026-01-28 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 15ece578-2949-564a-8b35-079dd67de311 with identifier: 119098627
2026-01-28 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 15ece578-2949-564a-8b35-079dd67de311 with identifier: 119098627 to the API
2026-01-28 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2715ece578-2949-564a-8b35-079dd67de311%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 15ece578-2949-564a-8b35-079dd67de311: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119098627?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '15ece578-2949-564a-8b35-079dd67de311',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DV17OUA',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098627',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VAUXHALL',
'model': 'ASTRA HATCHBACK',
'odometer': 85797,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seller_name': 'Local Dealer Group',
'title': 'VAUXHALL ASTRA HATCHBACK 1.4T 16V 150 Elite Nav 5dr',
'transmission': 'manual',
'trim': '1.4T 16V 150 Elite Nav 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119098627%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Saving data for 119098627: {'created_time': 1769626861.764135, 'last_price_update_time': 1769626861.764147, 'auction_closing_time': 1770112800.0}
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119098627') HTTP/1.1" 204 0
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 118586554
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118586554%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Scrape type for 118586554: 2
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119095442?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118890833?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119044107?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119097246?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 118827410
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118827410%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Scrape type for 118827410: 2
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116617318?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119096696?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252Fd6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 119039821
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119039821%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Scrape type for 119039821: 0
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 119046990
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119046990%27 HTTP/1.1" 200 None
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Scrape type for 119046990: 0
2026-01-28 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 119037234
2026-01-28 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037234%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Scrape type for 119037234: 1
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 118649320
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118649320%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Scrape type for 118649320: 2
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 119051634
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119051634%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Scrape type for 119051634: 1
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191880190>
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119019822, 'registration': 'VE66VCP', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Acenta 5dr [7 Seat]', 'mileage': 103889, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-01', 'fuel': 'Diesel', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8bc6f59-ad69-4913-8300-134b11d723dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119019822, 'registration': 'VE66VCP', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Acenta 5dr [7 Seat]', 'mileage': 103889, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-01', 'fuel': 'Diesel', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8bc6f59-ad69-4913-8300-134b11d723dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ac3c33-866c-5b44-8409-bf0bc5811e62 with identifier: 119019822
2026-01-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ac3c33-866c-5b44-8409-bf0bc5811e62 with scrape type 1
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Ffe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119095442, 'registration': 'FH19VGE', 'account': 'MOT075', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 EcoBlue 150 Zetec 5dr Auto [8 Speed]', 'mileage': 147924, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-08-08', 'fuel': 'Diesel', 'motExpiry': '2025-06-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/551914e0-5d8f-40c7-91f8-32eabab80e0d.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119095442, 'registration': 'FH19VGE', 'account': 'MOT075', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 EcoBlue 150 Zetec 5dr Auto [8 Speed]', 'mileage': 147924, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-08-08', 'fuel': 'Diesel', 'motExpiry': '2025-06-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/551914e0-5d8f-40c7-91f8-32eabab80e0d.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 with identifier: 119095442
2026-01-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 with scrape type 1
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510
2026-01-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510, identifier: 119095442
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118890833, 'registration': 'CA72XBC', 'account': 'JUS112', 'make': 'CITROEN', 'model': 'C5 X ESTATE', 'derivative': '1.2 PureTech 130 Shine 5dr EAT8', 'mileage': 53933, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CA72XBC/2026-01-23/image/3a5195c5-bec1-405b-8fbb-49172c4c60f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/013fe520-cdb8-4d90-8de4-0544a30c0ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/f162c6fc-501d-4863-ac8d-a9945bf59b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/393c1a54-30ab-4244-8ff4-4f07f4257421_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/d55bae89-a771-4f13-8668-1fb511f710f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/bcdb43ab-988e-419c-ad0f-78b5b3171d7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/c497f9e2-9ad0-4fc2-937a-6cd988689457_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/a710ce24-7567-495c-8785-1f5e236eff14_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/25 42K', 'remarks': 'V5 COPY, VOSA STATES 51K SPARE KEY', 'virtual': False, 'seller': 'Just Vehicle Solutions', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/298e0d41-743f-46d1-ba0d-1c43182ea4d3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118890833, 'registration': 'CA72XBC', 'account': 'JUS112', 'make': 'CITROEN', 'model': 'C5 X ESTATE', 'derivative': '1.2 PureTech 130 Shine 5dr EAT8', 'mileage': 53933, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CA72XBC/2026-01-23/image/3a5195c5-bec1-405b-8fbb-49172c4c60f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/013fe520-cdb8-4d90-8de4-0544a30c0ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/f162c6fc-501d-4863-ac8d-a9945bf59b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/393c1a54-30ab-4244-8ff4-4f07f4257421_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/d55bae89-a771-4f13-8668-1fb511f710f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/bcdb43ab-988e-419c-ad0f-78b5b3171d7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/c497f9e2-9ad0-4fc2-937a-6cd988689457_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA72XBC/2026-01-23/image/a710ce24-7567-495c-8785-1f5e236eff14_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/25 42K', 'remarks': 'V5 COPY, VOSA STATES 51K SPARE KEY', 'virtual': False, 'seller': 'Just Vehicle Solutions', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/298e0d41-743f-46d1-ba0d-1c43182ea4d3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ef2c23-efe7-508e-9deb-4801fa77493e with identifier: 118890833
2026-01-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ef2c23-efe7-508e-9deb-4801fa77493e with scrape type 2
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0ef2c23-efe7-508e-9deb-4801fa77493e with scrape type 2
2026-01-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f0ef2c23-efe7-508e-9deb-4801fa77493e, identifier: 118890833
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119044107, 'registration': 'NL16KOJ', 'account': 'WBA003', 'make': 'VOLKSWAGEN', 'model': 'SHARAN DIESEL ESTATE', 'derivative': '2.0 TDI CR BlueMotion Tech 150 SE Nav 5dr', 'mileage': 133390, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/838b875c-ece2-4ad7-b3a2-c9530909961b.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119044107, 'registration': 'NL16KOJ', 'account': 'WBA003', 'make': 'VOLKSWAGEN', 'model': 'SHARAN DIESEL ESTATE', 'derivative': '2.0 TDI CR BlueMotion Tech 150 SE Nav 5dr', 'mileage': 133390, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/838b875c-ece2-4ad7-b3a2-c9530909961b.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede28574-09b5-5ecc-a8b2-cde95557ef34 with identifier: 119044107
2026-01-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede28574-09b5-5ecc-a8b2-cde95557ef34 with scrape type 1
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ede28574-09b5-5ecc-a8b2-cde95557ef34
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ede28574-09b5-5ecc-a8b2-cde95557ef34
2026-01-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ede28574-09b5-5ecc-a8b2-cde95557ef34, identifier: 119044107
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119097246, 'registration': 'WR72SEO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 27681, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-01-09', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 26k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119097246, 'registration': 'WR72SEO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 27681, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-01-09', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 26k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b34a01-3c60-52df-95cb-2dcb6155758f with identifier: 119097246
2026-01-28 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b34a01-3c60-52df-95cb-2dcb6155758f with scrape type 1
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b1b34a01-3c60-52df-95cb-2dcb6155758f
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b1b34a01-3c60-52df-95cb-2dcb6155758f
2026-01-28 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b1b34a01-3c60-52df-95cb-2dcb6155758f, identifier: 119097246
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 with identifier: 119095442
2026-01-28 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 with identifier: 119095442
2026-01-28 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'ford s-max diesel estate 2.0 ecoblue 150 zetec 5dr auto [8 speed]', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 's-max diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 147924, 'odometer_reading_unit': 'mi', 'registration_date': '2019-08-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119095442', 'expiration_date': '2026-02-03t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '2.0 ecoblue 150 zetec 5dr auto [8 speed]', 'license_plate': 'fh19vge', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510', 'current_year_diff': 7, 'age_in_months': 77, 'make_model': 'ford s-max diesel estate', 'sanitized_make': 'ford', 'odometer_in_km': 238060}
Failed validating None in schema:
False
On instance:
{'age_in_months': 77,
'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-02-03t10:00:00z',
'fuel_type': 'diesel',
'id': 'aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'fh19vge',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119095442',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'ford',
'make_model': 'ford s-max diesel estate',
'model': 's-max diesel estate',
'odometer': 147924,
'odometer_in_km': 238060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'sanitized_make': 'ford',
'seller_name': 'motonovo finance',
'title': 'ford s-max diesel estate 2.0 ecoblue 150 zetec 5dr auto [8 '
'speed]',
'transmission': 'automatic',
'trim': '2.0 ecoblue 150 zetec 5dr auto [8 speed]',
'vin': None,
'year': 2019}
2026-01-28 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 spider: astonbarclay.gb
2026-01-28 19:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'ford s-max diesel estate 2.0 ecoblue 150 zetec 5dr auto [8 speed]', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 's-max diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 147924, 'odometer_reading_unit': 'mi', 'registration_date': '2019-08-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119095442', 'expiration_date': '2026-02-03t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '2.0 ecoblue 150 zetec 5dr auto [8 speed]', 'license_plate': 'fh19vge', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510', 'current_year_diff': 7, 'age_in_months': 77, 'make_model': 'ford s-max diesel estate', 'sanitized_make': 'ford', 'odometer_in_km': 238060}
Failed validating None in schema:
False
On instance:
{'age_in_months': 77,
'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-02-03t10:00:00z',
'fuel_type': 'diesel',
'id': 'aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'fh19vge',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119095442',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'ford',
'make_model': 'ford s-max diesel estate',
'model': 's-max diesel estate',
'odometer': 147924,
'odometer_in_km': 238060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'sanitized_make': 'ford',
'seller_name': 'motonovo finance',
'title': 'ford s-max diesel estate 2.0 ecoblue 150 zetec 5dr auto [8 '
'speed]',
'transmission': 'automatic',
'trim': '2.0 ecoblue 150 zetec 5dr auto [8 speed]',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aa4d88bf-c4a9-5be5-8bcd-6e0cb4777510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FH19VGE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119095442',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'FORD',
'model': 'S-MAX DIESEL ESTATE',
'odometer': 147924,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'seller_name': 'MotoNovo Finance',
'title': 'FORD S-MAX DIESEL ESTATE 2.0 EcoBlue 150 Zetec 5dr Auto [8 Speed]',
'transmission': 'automatic',
'trim': '2.0 EcoBlue 150 Zetec 5dr Auto [8 Speed]',
'vin': None,
'year': 2019}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119095442%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [astonbarclay.gb] INFO: Saving data for 119095442: {'created_time': 1769626863.080882, 'last_price_update_time': 1769626863.080892, 'auction_closing_time': 1770112800.0}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119095442') HTTP/1.1" 204 0
2026-01-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f0ef2c23-efe7-508e-9deb-4801fa77493e with identifier: 118890833
2026-01-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f0ef2c23-efe7-508e-9deb-4801fa77493e with identifier: 118890833
2026-01-28 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f0ef2c23-efe7-508e-9deb-4801fa77493e with identifier: 118890833 to the API
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f0ef2c23-efe7-508e-9deb-4801fa77493e%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f0ef2c23-efe7-508e-9deb-4801fa77493e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118890833?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': 'f0ef2c23-efe7-508e-9deb-4801fa77493e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CA72XBC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118890833',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'CITROEN',
'model': 'C5 X ESTATE',
'odometer': 53933,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seller_name': 'Just Vehicle Solutions',
'title': 'CITROEN C5 X ESTATE 1.2 PureTech 130 Shine 5dr EAT8',
'transmission': 'automatic',
'trim': '1.2 PureTech 130 Shine 5dr EAT8',
'vin': None,
'year': 2022}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118890833%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [astonbarclay.gb] INFO: Saving data for 118890833: {'auction_closing_time': 1769774400.0, 'created_time': 1769108450.354095, 'last_price_update_time': 1769626863.3682}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118890833') HTTP/1.1" 204 0
2026-01-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ede28574-09b5-5ecc-a8b2-cde95557ef34 with identifier: 119044107
2026-01-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ede28574-09b5-5ecc-a8b2-cde95557ef34 with identifier: 119044107
2026-01-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'volkswagen sharan diesel estate 2.0 tdi cr bluemotion tech 150 se nav 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'sharan diesel estate', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 133390, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044107', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr bluemotion tech 150 se nav 5dr', 'license_plate': 'nl16koj', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 130, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ede28574-09b5-5ecc-a8b2-cde95557ef34', 'current_year_diff': 10, 'age_in_months': 117, 'make_model': 'volkswagen sharan diesel estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 214669}
Failed validating None in schema:
False
On instance:
{'age_in_months': 117,
'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'diesel',
'id': 'ede28574-09b5-5ecc-a8b2-cde95557ef34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'nl16koj',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044107',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'volkswagen',
'make_model': 'volkswagen sharan diesel estate',
'model': 'sharan diesel estate',
'odometer': 133390,
'odometer_in_km': 214669,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'sanitized_make': 'volkswagen',
'seller_name': 'ukcgr - select',
'title': 'volkswagen sharan diesel estate 2.0 tdi cr bluemotion tech '
'150 se nav 5dr',
'transmission': 'manual',
'trim': '2.0 tdi cr bluemotion tech 150 se nav 5dr',
'vin': None,
'year': 2016}
2026-01-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ede28574-09b5-5ecc-a8b2-cde95557ef34 spider: astonbarclay.gb
2026-01-28 19:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ede28574-09b5-5ecc-a8b2-cde95557ef34 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'volkswagen sharan diesel estate 2.0 tdi cr bluemotion tech 150 se nav 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'sharan diesel estate', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 133390, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044107', 'expiration_date': '2026-02-02t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr bluemotion tech 150 se nav 5dr', 'license_plate': 'nl16koj', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 130, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ede28574-09b5-5ecc-a8b2-cde95557ef34', 'current_year_diff': 10, 'age_in_months': 117, 'make_model': 'volkswagen sharan diesel estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 214669}
Failed validating None in schema:
False
On instance:
{'age_in_months': 117,
'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-02-02t17:30:00z',
'fuel_type': 'diesel',
'id': 'ede28574-09b5-5ecc-a8b2-cde95557ef34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'nl16koj',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044107',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'volkswagen',
'make_model': 'volkswagen sharan diesel estate',
'model': 'sharan diesel estate',
'odometer': 133390,
'odometer_in_km': 214669,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'sanitized_make': 'volkswagen',
'seller_name': 'ukcgr - select',
'title': 'volkswagen sharan diesel estate 2.0 tdi cr bluemotion tech '
'150 se nav 5dr',
'transmission': 'manual',
'trim': '2.0 tdi cr bluemotion tech 150 se nav 5dr',
'vin': None,
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Diesel',
'id': 'ede28574-09b5-5ecc-a8b2-cde95557ef34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'NL16KOJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044107',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VOLKSWAGEN',
'model': 'SHARAN DIESEL ESTATE',
'odometer': 133390,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': 'UKCGR - Select',
'title': 'VOLKSWAGEN SHARAN DIESEL ESTATE 2.0 TDI CR BlueMotion Tech 150 SE '
'Nav 5dr',
'transmission': 'manual',
'trim': '2.0 TDI CR BlueMotion Tech 150 SE Nav 5dr',
'vin': None,
'year': 2016}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044107%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [astonbarclay.gb] INFO: Saving data for 119044107: {'created_time': 1769626863.581715, 'last_price_update_time': 1769626863.581725, 'auction_closing_time': 1770053400.0}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119044107') HTTP/1.1" 204 0
2026-01-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b1b34a01-3c60-52df-95cb-2dcb6155758f with identifier: 119097246
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2026-01-28 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b1b34a01-3c60-52df-95cb-2dcb6155758f with identifier: 119097246
2026-01-28 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b1b34a01-3c60-52df-95cb-2dcb6155758f with identifier: 119097246 to the API
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b1b34a01-3c60-52df-95cb-2dcb6155758f%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b1b34a01-3c60-52df-95cb-2dcb6155758f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119097246?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GREEN',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': 'b1b34a01-3c60-52df-95cb-2dcb6155758f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WR72SEO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119097246',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'VAUXHALL',
'model': 'MOKKA HATCHBACK',
'odometer': 27681,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-09',
'seller_name': 'Motability Operations',
'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo Ultimate 5dr',
'transmission': 'manual',
'trim': '1.2 Turbo Ultimate 5dr',
'vin': None,
'year': 2023}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097246%27 HTTP/1.1" 200 None
2026-01-28 19:01:03 [astonbarclay.gb] INFO: Saving data for 119097246: {'created_time': 1769626863.991224, 'last_price_update_time': 1769626863.991235, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119097246') HTTP/1.1" 204 0
2026-01-28 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 118974976
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974976%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Scrape type for 118974976: 0
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 119017580
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119017580%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Scrape type for 119017580: 0
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 118948685
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948685%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Scrape type for 118948685: 2
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Faee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116617318, 'registration': 'HS16FWW', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr', 'mileage': 98867, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16FWW/2025-10-24/image/5984fd43-b91e-41fb-9d26-7f8a26e9a75d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/20c35d4d-31ad-43ce-a188-c6870be5575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/e332be3b-e053-43c4-a40e-7b5eea278cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/fa8f3acb-4fd1-4b60-81b1-1f6ceb28fe1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/57337dea-1936-463f-aa57-f5db6d0cd64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/99d2f96e-8b10-49bc-a02f-cc1de905e1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/caa110d3-3848-433e-81f5-d8de4fa1802f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/79693944-41e7-4bf2-9696-cefc98dce830_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/18 21K 12/18 45K', 'remarks': 'VOSA STATES 59K 73K 79K 87K 92K 97K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60a25621-1906-4a9e-ad06-d6747fd76cb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116617318, 'registration': 'HS16FWW', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr', 'mileage': 98867, 'mileageWarranty': True, 'type': 'car', 'saleId': 18362, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16FWW/2025-10-24/image/5984fd43-b91e-41fb-9d26-7f8a26e9a75d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/20c35d4d-31ad-43ce-a188-c6870be5575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/e332be3b-e053-43c4-a40e-7b5eea278cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/fa8f3acb-4fd1-4b60-81b1-1f6ceb28fe1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/57337dea-1936-463f-aa57-f5db6d0cd64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/99d2f96e-8b10-49bc-a02f-cc1de905e1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/caa110d3-3848-433e-81f5-d8de4fa1802f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/79693944-41e7-4bf2-9696-cefc98dce830_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/18 21K 12/18 45K', 'remarks': 'VOSA STATES 59K 73K 79K 87K 92K 97K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60a25621-1906-4a9e-ad06-d6747fd76cb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2026-01-28 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with scrape type 2
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with scrape type 2
2026-01-28 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3, identifier: 116617318
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119096696, 'registration': 'FY70WWN', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'RIFTER DIESEL ESTATE', 'derivative': '1.5 BlueHDi 100 Active [7 Seats] 5dr', 'mileage': 58434, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-09-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 39k, 45k, 55k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119096696, 'registration': 'FY70WWN', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'RIFTER DIESEL ESTATE', 'derivative': '1.5 BlueHDi 100 Active [7 Seats] 5dr', 'mileage': 58434, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-09-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 39k, 45k, 55k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b0f309-83d3-504f-a910-b528dfcc2f27 with identifier: 119096696
2026-01-28 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b0f309-83d3-504f-a910-b528dfcc2f27 with scrape type 1
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 65b0f309-83d3-504f-a910-b528dfcc2f27
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 65b0f309-83d3-504f-a910-b528dfcc2f27
2026-01-28 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 65b0f309-83d3-504f-a910-b528dfcc2f27, identifier: 119096696
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159110 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159110
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 spider: astonbarclay.gb
2026-01-28 19:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 due to rule: high_mileage_for_country.json, error: 159110 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159110
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '6cccaf5b-b4bc-5055-8624-499a5dfeecf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'HS16FWW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116617318',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
'odometer': 98867,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': 'Zuto',
'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr',
'transmission': 'manual',
'trim': '2.0 TD4 SE Tech 5dr',
'vin': None,
'year': 2016}
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Saving data for 116617318: {'auction_closing_time': 1769774400.0, 'created_time': 1767985493.752593, 'last_price_update_time': 1769626864.470069}
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116617318') HTTP/1.1" 204 0
2026-01-28 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 65b0f309-83d3-504f-a910-b528dfcc2f27 with identifier: 119096696
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 65b0f309-83d3-504f-a910-b528dfcc2f27 with identifier: 119096696
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter diesel estate' containing 'rifter'
2026-01-28 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 65b0f309-83d3-504f-a910-b528dfcc2f27 spider: astonbarclay.gb
2026-01-28 19:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 65b0f309-83d3-504f-a910-b528dfcc2f27 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter diesel estate' containing 'rifter'
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Diesel',
'id': '65b0f309-83d3-504f-a910-b528dfcc2f27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FY70WWN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119096696',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': 'RIFTER DIESEL ESTATE',
'odometer': 58434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seller_name': 'Motability Operations',
'title': 'PEUGEOT RIFTER DIESEL ESTATE 1.5 BlueHDi 100 Active [7 Seats] 5dr',
'transmission': 'manual',
'trim': '1.5 BlueHDi 100 Active [7 Seats] 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119096696%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Saving data for 119096696: {'created_time': 1769626864.679164, 'last_price_update_time': 1769626864.679174, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119096696') HTTP/1.1" 204 0
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 118948869
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948869%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [astonbarclay.gb] INFO: Scrape type for 118948869: 2
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902ea150>
2026-01-28 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252Fbfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948972
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948972%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948972: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Ffa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948960
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948960%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948960: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948647
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948647%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948647: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118556355?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948941
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948941%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948941: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948911
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948911%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948911: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948922
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948922%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948922: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923392
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923392%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923392: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923375
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923375%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923375: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F293874e8-1154-42a8-baf8-df636d776868_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923415
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923415%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923415: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923432
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923432%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923432: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923448
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923448%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923448: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118925390
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118925390%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118925390: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118943989
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118943989%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118943989: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118529919
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118529919%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118529919: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319030cc10>
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Ffe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118557481
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118557481%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118557481: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:05 [scrapy.extensions.logstats] INFO: Crawled 76 pages (at 76 pages/min), scraped 19 items (at 19 items/min)
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118556355, 'registration': 'RF73HKW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 13067, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF73HKW/2026-01-23/image/57c9df3f-f80b-4bd8-9ca1-d42e98a6f9c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/e2116ff2-662b-461a-9a1c-5af1843a0325_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/a794d083-c1c1-43d3-a118-cb5f32c76739_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/12868846-7260-4272-a312-1dbc71ace4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/27451a3c-fe41-4f75-880a-0a0924694c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/42b4d5b7-f97a-42e9-8d80-debcd69b21ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/e96a852e-f83a-40be-80f4-9d34518bb205_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '*HPI STATES VEHICLE IS ORANGE, VEHICLE IS GREY*', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c381bee-5b02-44b5-a478-03e1377e72a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118556355, 'registration': 'RF73HKW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 13067, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF73HKW/2026-01-23/image/57c9df3f-f80b-4bd8-9ca1-d42e98a6f9c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/e2116ff2-662b-461a-9a1c-5af1843a0325_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/a794d083-c1c1-43d3-a118-cb5f32c76739_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/12868846-7260-4272-a312-1dbc71ace4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/27451a3c-fe41-4f75-880a-0a0924694c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/42b4d5b7-f97a-42e9-8d80-debcd69b21ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2026-01-23/image/e96a852e-f83a-40be-80f4-9d34518bb205_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '*HPI STATES VEHICLE IS ORANGE, VEHICLE IS GREY*', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c381bee-5b02-44b5-a478-03e1377e72a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 118556355
2026-01-28 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63246ade-69ee-559b-98d9-da2d4ee2cb0a with scrape type 2
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63246ade-69ee-559b-98d9-da2d4ee2cb0a with scrape type 2
2026-01-28 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 63246ade-69ee-559b-98d9-da2d4ee2cb0a, identifier: 118556355
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118990117
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990117%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118990117: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118990126
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990126%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118990126: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118990105
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990105%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118990105: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118978682
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118978682%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118978682: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118923489
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923489%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118923489: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118987006
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987006%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118987006: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118991199
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991199%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118991199: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118988962
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118988962%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118988962: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118986296
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118986296%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118986296: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118989036
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989036%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118989036: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118984774
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118984774%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118984774: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118994010
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994010%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118994010: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118952879
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118952879%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118952879: 0
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 118948852
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948852%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [astonbarclay.gb] INFO: Scrape type for 118948852: 2
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119097348?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119075537?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118601267?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118775460?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 118556355
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2026-01-28 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 118556355
2026-01-28 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 118556355 to the API
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118556355?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'ORANGE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '63246ade-69ee-559b-98d9-da2d4ee2cb0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RF73HKW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118556355',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'JEEP',
'model': 'AVENGER HATCHBACK',
'odometer': 13067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-13',
'seller_name': 'Motability Operations',
'title': 'JEEP AVENGER HATCHBACK 1.2 Altitude+ 5dr',
'transmission': 'manual',
'trim': '1.2 Altitude+ 5dr',
'vin': None,
'year': 2024}
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118556355%27 HTTP/1.1" 200 None
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Saving data for 118556355: {'auction_closing_time': 1770114600.0, 'created_time': 1768590610.218671, 'last_price_update_time': 1769626866.475187}
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118556355') HTTP/1.1" 204 0
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 118977256
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118977256%27 HTTP/1.1" 200 None
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Scrape type for 118977256: 0
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 118974955
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974955%27 HTTP/1.1" 200 None
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Scrape type for 118974955: 0
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 119038618
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119038618%27 HTTP/1.1" 200 None
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Scrape type for 119038618: 0
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 118949019
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118949019%27 HTTP/1.1" 200 None
2026-01-28 19:01:06 [astonbarclay.gb] INFO: Scrape type for 118949019: 2
2026-01-28 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319037b390>
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190503790>
2026-01-28 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319037ab10>
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319049d690>
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 118972676
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118972676%27 HTTP/1.1" 200 None
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Scrape type for 118972676: 0
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 118974990
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974990%27 HTTP/1.1" 200 None
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Scrape type for 118974990: 0
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 119098860
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119098860%27 HTTP/1.1" 200 None
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Scrape type for 119098860: 1
2026-01-28 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118379658?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119063131, 'registration': 'YC72FKG', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 6214, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23- 14k, 06/24- 25k, 11/24- 35k', 'remarks': 'vosa - 52k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f2198c49-fcab-47bb-92dd-567fb4c697a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119063131, 'registration': 'YC72FKG', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 6214, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23- 14k, 06/24- 25k, 11/24- 35k', 'remarks': 'vosa - 52k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f2198c49-fcab-47bb-92dd-567fb4c697a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fe7b42-fff0-574d-bbdd-7696e1d40eca with identifier: 119063131
2026-01-28 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca with scrape type 1
2026-01-28 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fe654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119097348, 'registration': 'KR24JXO', 'account': 'MOT070', 'make': 'SEAT', 'model': 'TARRACO DIESEL ESTATE', 'derivative': '2.0 TDI FR 5dr DSG', 'mileage': 40310, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-04-15', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119097348, 'registration': 'KR24JXO', 'account': 'MOT070', 'make': 'SEAT', 'model': 'TARRACO DIESEL ESTATE', 'derivative': '2.0 TDI FR 5dr DSG', 'mileage': 40310, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-04-15', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fb8e61-059c-5d92-a823-0c17eda8caff with identifier: 119097348
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fb8e61-059c-5d92-a823-0c17eda8caff with scrape type 1
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f8fb8e61-059c-5d92-a823-0c17eda8caff
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f8fb8e61-059c-5d92-a823-0c17eda8caff
2026-01-28 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8fb8e61-059c-5d92-a823-0c17eda8caff, identifier: 119097348
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119075537, 'registration': 'LR72RUO', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 39395, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119075537, 'registration': 'LR72RUO', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 39395, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b95afc-42a7-53e0-891b-61a8f242aeb4 with identifier: 119075537
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b95afc-42a7-53e0-891b-61a8f242aeb4 with scrape type 1
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 45b95afc-42a7-53e0-891b-61a8f242aeb4
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 45b95afc-42a7-53e0-891b-61a8f242aeb4
2026-01-28 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 45b95afc-42a7-53e0-891b-61a8f242aeb4, identifier: 119075537
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118331157, 'registration': 'RMN207A', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.6 GDi Hybrid Premium 5dr DCT', 'mileage': 11654, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book ??-4K, 10/24-8K, 10/25-11K', 'remarks': 'SPARE KEY IN OFFICE, IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b0c7bc5-7de8-4c30-a488-563f684cfe55.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118331157, 'registration': 'RMN207A', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.6 GDi Hybrid Premium 5dr DCT', 'mileage': 11654, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book ??-4K, 10/24-8K, 10/25-11K', 'remarks': 'SPARE KEY IN OFFICE, IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b0c7bc5-7de8-4c30-a488-563f684cfe55.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61784c54-d8c3-5601-b33d-ba84d750aefa with identifier: 118331157
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61784c54-d8c3-5601-b33d-ba84d750aefa with scrape type 1
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118601267, 'registration': 'AK18OGP', 'account': 'WBA002', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 95055, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-03', 'fuel': 'Petrol', 'motExpiry': '2026-06-13', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AK18OGP/2026-01-16/image/7ff659c7-9298-4f3f-88b5-8356b62e8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/2c3050e6-d8ce-4272-8be7-fcafab63f058_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/4947b57c-70f5-4dfe-92a2-f98e50c631a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/334950fe-58a3-4751-897a-1f9959ea983e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/0d268151-9230-41d2-b3dd-c77f02e94276_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/e987e642-c06c-490c-aeea-cacae6690721_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/4507ad95-a3af-4b66-80ea-cabb6e9e5278_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/bed6c32e-28e9-4fec-9525-020cd6db3ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/90110ecd-809c-4b5c-9f18-909a7d1e94c6_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18- 11K, 06/19- 24K, 07/20- 37K, 06/21- 19K, 06/25- 90K,', 'remarks': '**602**VOSA STATES 47K, 56K, 64K, 72K, 90K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9b75b19-4e05-4e88-86b9-9b52108a8e42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118601267, 'registration': 'AK18OGP', 'account': 'WBA002', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 95055, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-03', 'fuel': 'Petrol', 'motExpiry': '2026-06-13', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AK18OGP/2026-01-16/image/7ff659c7-9298-4f3f-88b5-8356b62e8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/2c3050e6-d8ce-4272-8be7-fcafab63f058_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/4947b57c-70f5-4dfe-92a2-f98e50c631a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/334950fe-58a3-4751-897a-1f9959ea983e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/0d268151-9230-41d2-b3dd-c77f02e94276_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/e987e642-c06c-490c-aeea-cacae6690721_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/4507ad95-a3af-4b66-80ea-cabb6e9e5278_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/bed6c32e-28e9-4fec-9525-020cd6db3ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18OGP/2026-01-16/image/90110ecd-809c-4b5c-9f18-909a7d1e94c6_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18- 11K, 06/19- 24K, 07/20- 37K, 06/21- 19K, 06/25- 90K,', 'remarks': '**602**VOSA STATES 47K, 56K, 64K, 72K, 90K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9b75b19-4e05-4e88-86b9-9b52108a8e42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8ce193-c6f3-54d9-8232-37b63a103b88 with identifier: 118601267
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8ce193-c6f3-54d9-8232-37b63a103b88 with scrape type 2
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f8ce193-c6f3-54d9-8232-37b63a103b88 with scrape type 2
2026-01-28 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f8ce193-c6f3-54d9-8232-37b63a103b88, identifier: 118601267
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118775460, 'registration': 'AO74VUE', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-3008 ELECTRIC ESTATE', 'derivative': '157kW GT 73kWh 5dr Auto', 'mileage': 1045, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-11-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO74VUE/2026-01-22/image/abf98a8c-189c-4ec5-82fa-26b8aa54b236_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/0830885b-d2d3-4d12-bd69-f6ea315cfa85_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/cd58fc3e-1122-4584-83f8-9dba529cf27c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/c3930474-83fb-43b2-8188-b0d1c258f91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/55908196-c30c-45e1-9a6b-b960bba56f75_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/c0627a10-889e-43a8-8134-835e7203f447_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/9bd146d0-9208-4e8b-b93d-7e1827683b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/9fef4520-5337-4b60-bd87-e32b9eb2f42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/864d91b4-5d5b-45af-a382-a088c613bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/047e629f-1594-4409-9bd1-e49d636131a8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/df248732-5b6a-43c4-8b4b-c64a42627547.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118775460, 'registration': 'AO74VUE', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-3008 ELECTRIC ESTATE', 'derivative': '157kW GT 73kWh 5dr Auto', 'mileage': 1045, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-11-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO74VUE/2026-01-22/image/abf98a8c-189c-4ec5-82fa-26b8aa54b236_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/0830885b-d2d3-4d12-bd69-f6ea315cfa85_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/cd58fc3e-1122-4584-83f8-9dba529cf27c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/c3930474-83fb-43b2-8188-b0d1c258f91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/55908196-c30c-45e1-9a6b-b960bba56f75_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/c0627a10-889e-43a8-8134-835e7203f447_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/9bd146d0-9208-4e8b-b93d-7e1827683b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/9fef4520-5337-4b60-bd87-e32b9eb2f42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/864d91b4-5d5b-45af-a382-a088c613bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2026-01-22/image/047e629f-1594-4409-9bd1-e49d636131a8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/df248732-5b6a-43c4-8b4b-c64a42627547.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea895d02-baba-5d8e-a79d-99ddb6a37d64 with identifier: 118775460
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea895d02-baba-5d8e-a79d-99ddb6a37d64 with scrape type 2
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea895d02-baba-5d8e-a79d-99ddb6a37d64 with scrape type 2
2026-01-28 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ea895d02-baba-5d8e-a79d-99ddb6a37d64, identifier: 118775460
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118137730, 'registration': 'RMN196A', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT', 'mileage': 22671, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'spare key, IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3b4bbb3-c104-4525-bcea-fe90631dbb97.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118137730, 'registration': 'RMN196A', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT', 'mileage': 22671, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'spare key, IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3b4bbb3-c104-4525-bcea-fe90631dbb97.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 with identifier: 118137730
2026-01-28 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 with scrape type 1
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 118991176
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991176%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Scrape type for 118991176: 0
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 118992485
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992485%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Scrape type for 118992485: 0
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 118926127
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118926127%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Scrape type for 118926127: 2
2026-01-28 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8fb8e61-059c-5d92-a823-0c17eda8caff with identifier: 119097348
2026-01-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8fb8e61-059c-5d92-a823-0c17eda8caff with identifier: 119097348
2026-01-28 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8fb8e61-059c-5d92-a823-0c17eda8caff with identifier: 119097348 to the API
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f8fb8e61-059c-5d92-a823-0c17eda8caff%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f8fb8e61-059c-5d92-a823-0c17eda8caff: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119097348?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Diesel',
'id': 'f8fb8e61-059c-5d92-a823-0c17eda8caff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KR24JXO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119097348',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'SEAT',
'model': 'TARRACO DIESEL ESTATE',
'odometer': 40310,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-15',
'seller_name': 'Motability Operations',
'title': 'SEAT TARRACO DIESEL ESTATE 2.0 TDI FR 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TDI FR 5dr DSG',
'vin': None,
'year': 2024}
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097348%27 HTTP/1.1" 200 None
2026-01-28 19:01:08 [astonbarclay.gb] INFO: Saving data for 119097348: {'created_time': 1769626868.838224, 'last_price_update_time': 1769626868.838236, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119097348') HTTP/1.1" 204 0
2026-01-28 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 45b95afc-42a7-53e0-891b-61a8f242aeb4 with identifier: 119075537
2026-01-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 45b95afc-42a7-53e0-891b-61a8f242aeb4 with identifier: 119075537
2026-01-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 39395, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075537', 'expiration_date': '2026-02-03t10:30:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '130kw trophy ev 51kwh 5dr auto', 'license_plate': 'lr72ruo', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '45b95afc-42a7-53e0-891b-61a8f242aeb4', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 63399} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-03t10:30:00z',
'fuel_type': 'electric',
'id': '45b95afc-42a7-53e0-891b-61a8f242aeb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lr72ruo',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075537',
'listing': 'auction',
'location': 'aston barclay prees heath',
'make': 'mg motor uk',
'make_model': 'mg motor uk zs electric hatchback',
'model': 'zs electric hatchback',
'odometer': 39395,
'odometer_in_km': 63399,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'mgmotoruk',
'seller_name': 'motability operations',
'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '130kw trophy ev 51kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 45b95afc-42a7-53e0-891b-61a8f242aeb4 spider: astonbarclay.gb
2026-01-28 19:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 45b95afc-42a7-53e0-891b-61a8f242aeb4 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 39395, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075537', 'expiration_date': '2026-02-03t10:30:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '130kw trophy ev 51kwh 5dr auto', 'license_plate': 'lr72ruo', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '45b95afc-42a7-53e0-891b-61a8f242aeb4', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 63399} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-03t10:30:00z',
'fuel_type': 'electric',
'id': '45b95afc-42a7-53e0-891b-61a8f242aeb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lr72ruo',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075537',
'listing': 'auction',
'location': 'aston barclay prees heath',
'make': 'mg motor uk',
'make_model': 'mg motor uk zs electric hatchback',
'model': 'zs electric hatchback',
'odometer': 39395,
'odometer_in_km': 63399,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'mgmotoruk',
'seller_name': 'motability operations',
'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '130kw trophy ev 51kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Electric',
'id': '45b95afc-42a7-53e0-891b-61a8f242aeb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR72RUO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075537',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'MG MOTOR UK',
'model': 'ZS ELECTRIC HATCHBACK',
'odometer': 39395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': 'Motability Operations',
'title': 'MG MOTOR UK ZS ELECTRIC HATCHBACK 130kW Trophy EV 51kWh 5dr Auto',
'transmission': 'automatic',
'trim': '130kW Trophy EV 51kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119075537%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Saving data for 119075537: {'created_time': 1769626869.081128, 'last_price_update_time': 1769626869.081138, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119075537') HTTP/1.1" 204 0
2026-01-28 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f8ce193-c6f3-54d9-8232-37b63a103b88 with identifier: 118601267
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f8ce193-c6f3-54d9-8232-37b63a103b88 with identifier: 118601267
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152975 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152975
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f8ce193-c6f3-54d9-8232-37b63a103b88 spider: astonbarclay.gb
2026-01-28 19:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4f8ce193-c6f3-54d9-8232-37b63a103b88 due to rule: high_mileage_for_country.json, error: 152975 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152975
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '4f8ce193-c6f3-54d9-8232-37b63a103b88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AK18OGP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118601267',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'HONDA',
'model': 'CIVIC HATCHBACK',
'odometer': 95055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-03',
'seller_name': 'UKCGR - Premium',
'title': 'HONDA CIVIC HATCHBACK 1.0 VTEC Turbo SR 5dr',
'transmission': 'manual',
'trim': '1.0 VTEC Turbo SR 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118601267%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Saving data for 118601267: {'auction_closing_time': 1769774400.0, 'created_time': 1768417549.246497, 'last_price_update_time': 1769626869.29275}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118601267') HTTP/1.1" 204 0
2026-01-28 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ea895d02-baba-5d8e-a79d-99ddb6a37d64 with identifier: 118775460
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ea895d02-baba-5d8e-a79d-99ddb6a37d64 with identifier: 118775460
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-3008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1045, 'odometer_reading_unit': 'mi', 'registration_date': '2024-11-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775460', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '157kw gt 73kwh 5dr auto', 'license_plate': 'ao74vue', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ea895d02-baba-5d8e-a79d-99ddb6a37d64', 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'peugeot e-3008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 1681} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 14,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'electric',
'id': 'ea895d02-baba-5d8e-a79d-99ddb6a37d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ao74vue',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775460',
'listing': 'auction',
'location': 'aston barclay prees heath',
'make': 'peugeot',
'make_model': 'peugeot e-3008 electric estate',
'model': 'e-3008 electric estate',
'odometer': 1045,
'odometer_in_km': 1681,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-19',
'sanitized_make': 'peugeot',
'seller_name': 'motability operations',
'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto',
'transmission': 'automatic',
'trim': '157kw gt 73kwh 5dr auto',
'vin': None,
'year': 2024}
2026-01-28 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ea895d02-baba-5d8e-a79d-99ddb6a37d64 spider: astonbarclay.gb
2026-01-28 19:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ea895d02-baba-5d8e-a79d-99ddb6a37d64 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-3008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1045, 'odometer_reading_unit': 'mi', 'registration_date': '2024-11-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775460', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '157kw gt 73kwh 5dr auto', 'license_plate': 'ao74vue', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ea895d02-baba-5d8e-a79d-99ddb6a37d64', 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'peugeot e-3008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 1681} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 14,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'electric',
'id': 'ea895d02-baba-5d8e-a79d-99ddb6a37d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ao74vue',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775460',
'listing': 'auction',
'location': 'aston barclay prees heath',
'make': 'peugeot',
'make_model': 'peugeot e-3008 electric estate',
'model': 'e-3008 electric estate',
'odometer': 1045,
'odometer_in_km': 1681,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-19',
'sanitized_make': 'peugeot',
'seller_name': 'motability operations',
'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto',
'transmission': 'automatic',
'trim': '157kw gt 73kwh 5dr auto',
'vin': None,
'year': 2024}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Electric',
'id': 'ea895d02-baba-5d8e-a79d-99ddb6a37d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AO74VUE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775460',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': 'E-3008 ELECTRIC ESTATE',
'odometer': 1045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-19',
'seller_name': 'Motability Operations',
'title': 'PEUGEOT E-3008 ELECTRIC ESTATE 157kW GT 73kWh 5dr Auto',
'transmission': 'automatic',
'trim': '157kW GT 73kWh 5dr Auto',
'vin': None,
'year': 2024}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775460%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Saving data for 118775460: {'auction_closing_time': 1769774400.0, 'created_time': 1768936314.863871, 'last_price_update_time': 1769626869.516659}
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118775460') HTTP/1.1" 204 0
2026-01-28 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Ffd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 118948598
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948598%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Scrape type for 118948598: 0
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 118923360
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923360%27 HTTP/1.1" 200 None
2026-01-28 19:01:09 [astonbarclay.gb] INFO: Scrape type for 118923360: 2
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904984d0>
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F293874e8-1154-42a8-baf8-df636d776868_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904fe0d0>
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118379658, 'registration': 'EP16JJU', 'account': 'MAN027', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '2.0 TSI R 5dr DSG', 'mileage': 93057, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-07-20', 'fuel': 'Petrol', 'motExpiry': '2026-04-21', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EP16JJU/2026-01-12/image/31336067-6bf0-4066-94e5-92d12659d791_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/9f2a5cd3-1edf-4064-b875-3882b0484b57_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/4a954c33-ac58-4489-8928-69e3a6d75618_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/5339eaf1-31e7-48ed-9e4e-1e348f9f4348_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/69701039-1d36-4bbb-8250-ac016fa60c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/732a3dd2-d458-43ad-9818-9caa1b4e337a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/02b2d9d9-1af8-4ed8-aa7f-8722c8092e0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/5d6e28c3-ccbb-4b0e-af76-17b0347f8c68_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/c190d9ff-ef07-420b-b9fc-24da26be0ec9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1413** VOSA STATES 44K, 53K, 55K, 65K, 73K, 82K, 88K SD CARD', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b03cad3d-f54c-4a7a-8c93-f683e35b7321.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118379658, 'registration': 'EP16JJU', 'account': 'MAN027', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '2.0 TSI R 5dr DSG', 'mileage': 93057, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-07-20', 'fuel': 'Petrol', 'motExpiry': '2026-04-21', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EP16JJU/2026-01-12/image/31336067-6bf0-4066-94e5-92d12659d791_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/9f2a5cd3-1edf-4064-b875-3882b0484b57_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/4a954c33-ac58-4489-8928-69e3a6d75618_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/5339eaf1-31e7-48ed-9e4e-1e348f9f4348_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/69701039-1d36-4bbb-8250-ac016fa60c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/732a3dd2-d458-43ad-9818-9caa1b4e337a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/02b2d9d9-1af8-4ed8-aa7f-8722c8092e0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/5d6e28c3-ccbb-4b0e-af76-17b0347f8c68_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP16JJU/2026-01-12/image/c190d9ff-ef07-420b-b9fc-24da26be0ec9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1413** VOSA STATES 44K, 53K, 55K, 65K, 73K, 82K, 88K SD CARD', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b03cad3d-f54c-4a7a-8c93-f683e35b7321.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 624404f9-4283-5b38-98b4-302f4231113a with identifier: 118379658
2026-01-28 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 624404f9-4283-5b38-98b4-302f4231113a with scrape type 2
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 624404f9-4283-5b38-98b4-302f4231113a with scrape type 2
2026-01-28 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 624404f9-4283-5b38-98b4-302f4231113a, identifier: 118379658
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F158594b3-5127-4a74-a256-6f835724120e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fc8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 624404f9-4283-5b38-98b4-302f4231113a with identifier: 118379658
2026-01-28 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 624404f9-4283-5b38-98b4-302f4231113a with identifier: 118379658
2026-01-28 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 624404f9-4283-5b38-98b4-302f4231113a spider: astonbarclay.gb
2026-01-28 19:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 624404f9-4283-5b38-98b4-302f4231113a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '624404f9-4283-5b38-98b4-302f4231113a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EP16JJU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118379658',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VOLKSWAGEN',
'model': 'GOLF HATCHBACK',
'odometer': 93057,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-20',
'seller_name': 'Mann Island Finance',
'title': 'VOLKSWAGEN GOLF HATCHBACK 2.0 TSI R 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI R 5dr DSG',
'vin': None,
'year': 2016}
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118379658%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [astonbarclay.gb] INFO: Saving data for 118379658: {'auction_closing_time': 1769774400.0, 'created_time': 1768503947.796069, 'last_price_update_time': 1769626870.72258}
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118379658') HTTP/1.1" 204 0
2026-01-28 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 118923468
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923468%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [astonbarclay.gb] INFO: Scrape type for 118923468: 2
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118529919?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118923375?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118955034?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948852?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118360675?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319034f1d0>
2026-01-28 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190471550>
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a1910>
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252F648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 118741643
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118741643%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Scrape type for 118741643: 2
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fdf36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118586554?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 118923512
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923512%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Scrape type for 118923512: 2
2026-01-28 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 118432035
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118432035%27 HTTP/1.1" 200 None
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Scrape type for 118432035: 2
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118529919, 'registration': 'KO69NNR', 'account': 'AST058', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr [6 speed]', 'mileage': 31032, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KO69NNR/2026-01-12/image/fd2c1b23-e010-4be4-a0cf-a40010e5d3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/068318d1-05c2-4c08-8fe6-a7637bb2f1c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/47c46b17-4c09-4342-abca-5ec9f44b6c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/80abfea9-35be-4f81-8ffd-da459c97e831_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/38afe73f-73cd-4796-80e2-edfb2df4ade3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/93446d4a-1e9e-4272-a494-017d6158ebe8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/3b12b488-5b5e-4505-a3d0-e1ef22584f52_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/b9c607ac-f202-4a8a-bce4-ab56f585fdfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/f1b839f5-c6e5-4273-9554-956770bdaba7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/23 - 20K, 03/25 - 30K', 'remarks': '**1853**VOSA STATES 20K, 27K, 30K,', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/608a08fb-640a-43ba-baa0-ec049051d43e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118529919, 'registration': 'KO69NNR', 'account': 'AST058', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr [6 speed]', 'mileage': 31032, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KO69NNR/2026-01-12/image/fd2c1b23-e010-4be4-a0cf-a40010e5d3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/068318d1-05c2-4c08-8fe6-a7637bb2f1c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/47c46b17-4c09-4342-abca-5ec9f44b6c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/80abfea9-35be-4f81-8ffd-da459c97e831_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/38afe73f-73cd-4796-80e2-edfb2df4ade3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/93446d4a-1e9e-4272-a494-017d6158ebe8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/3b12b488-5b5e-4505-a3d0-e1ef22584f52_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/b9c607ac-f202-4a8a-bce4-ab56f585fdfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO69NNR/2026-01-12/image/f1b839f5-c6e5-4273-9554-956770bdaba7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/23 - 20K, 03/25 - 30K', 'remarks': '**1853**VOSA STATES 20K, 27K, 30K,', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/608a08fb-640a-43ba-baa0-ec049051d43e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9213f4b4-b6e5-52e4-8392-b33789f87029 with identifier: 118529919
2026-01-28 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9213f4b4-b6e5-52e4-8392-b33789f87029 with scrape type 2
2026-01-28 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9213f4b4-b6e5-52e4-8392-b33789f87029 with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9213f4b4-b6e5-52e4-8392-b33789f87029, identifier: 118529919
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118923375, 'registration': 'KN18NLF', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Luxury 5dr Auto', 'mileage': 36230, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-14', 'fuel': 'Diesel', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/KN18NLF/2026-01-26/image/7cfb851e-c9d0-46b2-ba3f-8aed0eff1d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/5302fb22-c809-4bc0-8273-f516fb2f6016_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/daf961d8-7fbf-438c-8d30-01068a2cc9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/d76718d4-1245-48b8-9882-8727926834b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/2a62220b-4b87-4086-983b-10c380206144_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/025b0261-60ed-4347-a116-9a9bc76613d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/e8206237-9004-4ad5-9ca8-3fd72c12ca0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/2425bb3e-9cff-435f-83b1-de059cf59b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/d8a16a94-d757-4da8-816d-831f2d327e26_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20- 5K, 04/22- 15K, 02/24- 22K', 'remarks': '**73**VOSA STATES 9K, 15K, 20K, 24K, 32K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/25d280c5-3b5c-4e18-a55a-b86a38da0161.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118923375, 'registration': 'KN18NLF', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Luxury 5dr Auto', 'mileage': 36230, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-14', 'fuel': 'Diesel', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/KN18NLF/2026-01-26/image/7cfb851e-c9d0-46b2-ba3f-8aed0eff1d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/5302fb22-c809-4bc0-8273-f516fb2f6016_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/daf961d8-7fbf-438c-8d30-01068a2cc9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/d76718d4-1245-48b8-9882-8727926834b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/2a62220b-4b87-4086-983b-10c380206144_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/025b0261-60ed-4347-a116-9a9bc76613d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/e8206237-9004-4ad5-9ca8-3fd72c12ca0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/2425bb3e-9cff-435f-83b1-de059cf59b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN18NLF/2026-01-26/image/d8a16a94-d757-4da8-816d-831f2d327e26_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20- 5K, 04/22- 15K, 02/24- 22K', 'remarks': '**73**VOSA STATES 9K, 15K, 20K, 24K, 32K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/25d280c5-3b5c-4e18-a55a-b86a38da0161.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b5e1b2-7918-5dda-b542-b706d50156ed with identifier: 118923375
2026-01-28 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b5e1b2-7918-5dda-b542-b706d50156ed with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b5e1b2-7918-5dda-b542-b706d50156ed with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 94b5e1b2-7918-5dda-b542-b706d50156ed, identifier: 118923375
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118955034, 'registration': 'FP69TWK', 'account': 'MOT075', 'make': 'SEAT', 'model': 'LEON DIESEL HATCHBACK', 'derivative': '2.0 TDI 150 FR [EZ] 5dr', 'mileage': 101611, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-11-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP69TWK/2026-01-26/image/e9c159e1-18c3-470a-a79e-d1fe8c7dc11e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/91d5d85a-d4af-4569-bb6a-c7ebed6209ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/c7632356-4c29-4c8e-b131-ba5a6ea3a801_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/9aabf898-9a64-4896-ab44-f6e1b0942c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/d8f66537-828a-4b88-9a1d-9f3cdddaf7b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/525ef5af-619f-4c0a-a424-400dcbe562a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/369ccbf4-9df7-4ed2-9fcc-aeb67ff84c1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/79480e9c-8e16-4632-ba29-35132e45d8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/d0e465ab-1b10-4ca1-826f-575247be55de_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1645** VOSA STATES 51K, 61K, 81K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f53c78b-0693-42a6-866e-cc31d00b9372.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118955034, 'registration': 'FP69TWK', 'account': 'MOT075', 'make': 'SEAT', 'model': 'LEON DIESEL HATCHBACK', 'derivative': '2.0 TDI 150 FR [EZ] 5dr', 'mileage': 101611, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-11-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP69TWK/2026-01-26/image/e9c159e1-18c3-470a-a79e-d1fe8c7dc11e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/91d5d85a-d4af-4569-bb6a-c7ebed6209ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/c7632356-4c29-4c8e-b131-ba5a6ea3a801_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/9aabf898-9a64-4896-ab44-f6e1b0942c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/d8f66537-828a-4b88-9a1d-9f3cdddaf7b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/525ef5af-619f-4c0a-a424-400dcbe562a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/369ccbf4-9df7-4ed2-9fcc-aeb67ff84c1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/79480e9c-8e16-4632-ba29-35132e45d8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP69TWK/2026-01-26/image/d0e465ab-1b10-4ca1-826f-575247be55de_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1645** VOSA STATES 51K, 61K, 81K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f53c78b-0693-42a6-866e-cc31d00b9372.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35330d9f-6ec2-5def-857c-c54e8b81617a with identifier: 118955034
2026-01-28 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35330d9f-6ec2-5def-857c-c54e8b81617a with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35330d9f-6ec2-5def-857c-c54e8b81617a with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35330d9f-6ec2-5def-857c-c54e8b81617a, identifier: 118955034
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948852, 'registration': 'KN24RTU', 'account': 'HAT006', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line Premium Plus 4dr Tip Auto', 'mileage': 10313, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-01', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KN24RTU/2026-01-27/image/cf6e057a-3d65-4ec8-8c44-ffab96badcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/e037a186-a228-4f39-8c50-aa22702b61a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/49c4fc22-0c5d-4c5a-bbc7-8de9b36b12db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/d8fcab53-fefa-4071-b957-28993f780e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/9399e887-f83b-4d1d-a62d-4c052b5fc6f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/6b759641-3d5d-4aa5-b612-1ac806dafb12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/22283469-a7d5-4a6a-a6dd-30a628277d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/a6a88af5-2230-442b-9de8-3aa89e0826c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/42f45755-a9c8-4885-b720-23a6c8bab7b2_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 4K', 'remarks': '**44**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac72b2be-46e6-4469-ae42-d60a2c921240.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948852, 'registration': 'KN24RTU', 'account': 'HAT006', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line Premium Plus 4dr Tip Auto', 'mileage': 10313, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-01', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KN24RTU/2026-01-27/image/cf6e057a-3d65-4ec8-8c44-ffab96badcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/e037a186-a228-4f39-8c50-aa22702b61a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/49c4fc22-0c5d-4c5a-bbc7-8de9b36b12db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/d8fcab53-fefa-4071-b957-28993f780e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/9399e887-f83b-4d1d-a62d-4c052b5fc6f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/6b759641-3d5d-4aa5-b612-1ac806dafb12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/22283469-a7d5-4a6a-a6dd-30a628277d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/a6a88af5-2230-442b-9de8-3aa89e0826c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN24RTU/2026-01-27/image/42f45755-a9c8-4885-b720-23a6c8bab7b2_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 4K', 'remarks': '**44**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac72b2be-46e6-4469-ae42-d60a2c921240.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb222038-3803-52e9-9dc2-6a64026d30de with identifier: 118948852
2026-01-28 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb222038-3803-52e9-9dc2-6a64026d30de with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb222038-3803-52e9-9dc2-6a64026d30de with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fb222038-3803-52e9-9dc2-6a64026d30de, identifier: 118948852
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118360675, 'registration': 'GN17OTL', 'account': 'AST058', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi Nav 5dr', 'mileage': 79861, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GN17OTL/2026-01-06/image/d7caa8c2-b59a-4b9e-86af-f2315b03b72d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/35918e04-0ce6-4263-a898-15ded88de51a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/e1a24ad5-4847-4fc5-89dd-3e7162cf34e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/32619f3c-1b93-4875-8050-157173c4bbc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/5fa941be-95f1-4512-a41b-84d523fa635a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/403b06dc-e5aa-4910-9326-365f63bdf7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/17a214a8-65f7-481b-922b-0ea5cdf98ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/936b7d67-2f83-4c1e-b20d-6901044a4b16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/10cabe75-0281-463a-91e6-0d2b1bdffd89_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1431** VOSA STATES 41K, 48K, 55K, 65K, 74K, 77K,', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d37cc38-753b-45ad-af21-2fbc0b3e7ff1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118360675, 'registration': 'GN17OTL', 'account': 'AST058', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi Nav 5dr', 'mileage': 79861, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GN17OTL/2026-01-06/image/d7caa8c2-b59a-4b9e-86af-f2315b03b72d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/35918e04-0ce6-4263-a898-15ded88de51a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/e1a24ad5-4847-4fc5-89dd-3e7162cf34e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/32619f3c-1b93-4875-8050-157173c4bbc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/5fa941be-95f1-4512-a41b-84d523fa635a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/403b06dc-e5aa-4910-9326-365f63bdf7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/17a214a8-65f7-481b-922b-0ea5cdf98ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/936b7d67-2f83-4c1e-b20d-6901044a4b16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN17OTL/2026-01-06/image/10cabe75-0281-463a-91e6-0d2b1bdffd89_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1431** VOSA STATES 41K, 48K, 55K, 65K, 74K, 77K,', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d37cc38-753b-45ad-af21-2fbc0b3e7ff1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850b1418-b5a9-57af-b9ca-f44559b6b224 with identifier: 118360675
2026-01-28 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850b1418-b5a9-57af-b9ca-f44559b6b224 with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850b1418-b5a9-57af-b9ca-f44559b6b224 with scrape type 2
2026-01-28 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 850b1418-b5a9-57af-b9ca-f44559b6b224, identifier: 118360675
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fe14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9213f4b4-b6e5-52e4-8392-b33789f87029 with identifier: 118529919
2026-01-28 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9213f4b4-b6e5-52e4-8392-b33789f87029 with identifier: 118529919
2026-01-28 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9213f4b4-b6e5-52e4-8392-b33789f87029 with identifier: 118529919 to the API
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118529919?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '9213f4b4-b6e5-52e4-8392-b33789f87029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KO69NNR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118529919',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'CITROEN',
'model': 'C3 AIRCROSS HATCHBACK',
'odometer': 31032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-31',
'seller_name': 'LDG',
'title': 'CITROEN C3 AIRCROSS HATCHBACK 1.2 PureTech 110 Flair 5dr [6 speed]',
'transmission': 'manual',
'trim': '1.2 PureTech 110 Flair 5dr [6 speed]',
'vin': None,
'year': 2020}
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118529919%27 HTTP/1.1" 200 None
2026-01-28 19:01:12 [astonbarclay.gb] INFO: Saving data for 118529919: {'auction_closing_time': 1769774400.0, 'created_time': 1768244643.443722, 'last_price_update_time': 1769626872.765755}
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118529919') HTTP/1.1" 204 0
2026-01-28 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 94b5e1b2-7918-5dda-b542-b706d50156ed with identifier: 118923375
2026-01-28 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 94b5e1b2-7918-5dda-b542-b706d50156ed with identifier: 118923375
2026-01-28 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 94b5e1b2-7918-5dda-b542-b706d50156ed with identifier: 118923375 to the API
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2794b5e1b2-7918-5dda-b542-b706d50156ed%27 HTTP/1.1" 200 None
2026-01-28 19:01:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 94b5e1b2-7918-5dda-b542-b706d50156ed: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118923375?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '94b5e1b2-7918-5dda-b542-b706d50156ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KN18NLF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118923375',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT DIESEL SW',
'odometer': 36230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-14',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE Luxury 5dr '
'Auto',
'transmission': 'automatic',
'trim': '2.0 TD4 180 HSE Luxury 5dr Auto',
'vin': None,
'year': 2018}
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923375%27 HTTP/1.1" 200 None
2026-01-28 19:01:13 [astonbarclay.gb] INFO: Saving data for 118923375: {'auction_closing_time': 1770123600.0, 'created_time': 1769158954.424936, 'last_price_update_time': 1769626873.068918}
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118923375') HTTP/1.1" 204 0
2026-01-28 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35330d9f-6ec2-5def-857c-c54e8b81617a with identifier: 118955034
2026-01-28 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35330d9f-6ec2-5def-857c-c54e8b81617a with identifier: 118955034
2026-01-28 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163526 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163526
2026-01-28 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 35330d9f-6ec2-5def-857c-c54e8b81617a spider: astonbarclay.gb
2026-01-28 19:01:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 35330d9f-6ec2-5def-857c-c54e8b81617a due to rule: high_mileage_for_country.json, error: 163526 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163526
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '35330d9f-6ec2-5def-857c-c54e8b81617a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FP69TWK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118955034',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'SEAT',
'model': 'LEON DIESEL HATCHBACK',
'odometer': 101611,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-29',
'seller_name': 'MotoNovo Finance',
'title': 'SEAT LEON DIESEL HATCHBACK 2.0 TDI 150 FR [EZ] 5dr',
'transmission': 'manual',
'trim': '2.0 TDI 150 FR [EZ] 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118955034%27 HTTP/1.1" 200 None
2026-01-28 19:01:13 [astonbarclay.gb] INFO: Saving data for 118955034: {'auction_closing_time': 1769774400.0, 'created_time': 1769195103.102371, 'last_price_update_time': 1769626873.296032}
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118955034') HTTP/1.1" 204 0
2026-01-28 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fb222038-3803-52e9-9dc2-6a64026d30de with identifier: 118948852
2026-01-28 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fb222038-3803-52e9-9dc2-6a64026d30de with identifier: 118948852
2026-01-28 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fb222038-3803-52e9-9dc2-6a64026d30de with identifier: 118948852 to the API
2026-01-28 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fb222038-3803-52e9-9dc2-6a64026d30de%27 HTTP/1.1" 200 None
2026-01-28 19:01:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fb222038-3803-52e9-9dc2-6a64026d30de: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118948852?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'RED',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': 'fb222038-3803-52e9-9dc2-6a64026d30de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KN24RTU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948852',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MERCEDES-BENZ',
'model': 'CLA DIESEL COUPE',
'odometer': 10313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-01',
'seller_name': 'Hatfields Group',
'title': 'MERCEDES-BENZ CLA DIESEL COUPE CLA 220d AMG Line Premium Plus 4dr '
'Tip Auto',
'transmission': 'automatic',
'trim': 'CLA 220d AMG Line Premium Plus 4dr Tip Auto',
'vin': None,
'year': 2024}
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948852%27 HTTP/1.1" 200 None
2026-01-28 19:01:14 [astonbarclay.gb] INFO: Saving data for 118948852: {'auction_closing_time': 1770123600.0, 'created_time': 1769194992.409491, 'last_price_update_time': 1769626874.388497}
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948852') HTTP/1.1" 204 0
2026-01-28 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 850b1418-b5a9-57af-b9ca-f44559b6b224 with identifier: 118360675
2026-01-28 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 850b1418-b5a9-57af-b9ca-f44559b6b224 with identifier: 118360675
2026-01-28 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 850b1418-b5a9-57af-b9ca-f44559b6b224 with identifier: 118360675 to the API
2026-01-28 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118360675?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '850b1418-b5a9-57af-b9ca-f44559b6b224',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GN17OTL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118360675',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 79861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-13',
'seller_name': 'LDG',
'title': 'VAUXHALL ZAFIRA TOURER 1.4T SRi Nav 5dr',
'transmission': 'manual',
'trim': '1.4T SRi Nav 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118360675%27 HTTP/1.1" 200 None
2026-01-28 19:01:15 [astonbarclay.gb] INFO: Saving data for 118360675: {'auction_closing_time': 1769774400.0, 'created_time': 1767987434.62446, 'last_price_update_time': 1769626875.398544}
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118360675') HTTP/1.1" 204 0
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 119036643
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036643%27 HTTP/1.1" 200 None
2026-01-28 19:01:15 [astonbarclay.gb] INFO: Scrape type for 119036643: 0
2026-01-28 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 118724798
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724798%27 HTTP/1.1" 200 None
2026-01-28 19:01:15 [astonbarclay.gb] INFO: Scrape type for 118724798: 1
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190532390>
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190209610>
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 118940557
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118940557%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [astonbarclay.gb] INFO: Scrape type for 118940557: 1
2026-01-28 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118586554, 'registration': 'YL67EYD', 'account': 'STA058', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 131475, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-18', 'fuel': 'Petrol', 'motExpiry': '2026-04-13', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YL67EYD/2026-01-15/image/63caf670-cec0-4cb3-8094-bf8152f99df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/d626c524-75ae-4f23-ad48-ed26dde308ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/8474d6b6-6f32-4ecd-9a4a-5f54e79d2f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/bafeb5de-e163-4b3a-ae64-b8932ea5e1a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/54cc55aa-a7cd-4831-924e-f410dd703285_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/d781cf2d-328b-44e0-8796-7f3c1038e233_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/ad438cfd-e961-43da-90c2-5ca7a8e900ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/af60a151-fce3-4951-8a34-df5e151b27a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/0b56ff89-49d0-421e-8faf-399233142452_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/19 - 10K', 'remarks': '**1670** VOSA STATES 48K, 71K, 89K, 106K, 127K, SD CARD', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1af1f9d0-0ecb-497d-9f8f-c3a0a9eb824c.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118586554, 'registration': 'YL67EYD', 'account': 'STA058', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 131475, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-18', 'fuel': 'Petrol', 'motExpiry': '2026-04-13', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YL67EYD/2026-01-15/image/63caf670-cec0-4cb3-8094-bf8152f99df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/d626c524-75ae-4f23-ad48-ed26dde308ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/8474d6b6-6f32-4ecd-9a4a-5f54e79d2f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/bafeb5de-e163-4b3a-ae64-b8932ea5e1a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/54cc55aa-a7cd-4831-924e-f410dd703285_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/d781cf2d-328b-44e0-8796-7f3c1038e233_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/ad438cfd-e961-43da-90c2-5ca7a8e900ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/af60a151-fce3-4951-8a34-df5e151b27a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YL67EYD/2026-01-15/image/0b56ff89-49d0-421e-8faf-399233142452_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/19 - 10K', 'remarks': '**1670** VOSA STATES 48K, 71K, 89K, 106K, 127K, SD CARD', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1af1f9d0-0ecb-497d-9f8f-c3a0a9eb824c.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4227fc2f-0a51-5473-926d-b690a3dc33c7 with identifier: 118586554
2026-01-28 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4227fc2f-0a51-5473-926d-b690a3dc33c7 with scrape type 2
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4227fc2f-0a51-5473-926d-b690a3dc33c7 with scrape type 2
2026-01-28 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4227fc2f-0a51-5473-926d-b690a3dc33c7, identifier: 118586554
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4227fc2f-0a51-5473-926d-b690a3dc33c7 with identifier: 118586554
2026-01-28 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4227fc2f-0a51-5473-926d-b690a3dc33c7 with identifier: 118586554
2026-01-28 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'kia sportage estate 1.6 gdi isg 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sportage estate', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 131475, 'odometer_reading_unit': 'mi', 'registration_date': '2018-01-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118586554', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 gdi isg 2 5dr', 'license_plate': 'yl67eyd', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 147, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '4227fc2f-0a51-5473-926d-b690a3dc33c7', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'kia sportage estate', 'sanitized_make': 'kia', 'odometer_in_km': 211587}
Failed validating None in schema:
False
On instance:
{'age_in_months': 96,
'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'petrol',
'id': '4227fc2f-0a51-5473-926d-b690a3dc33c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'yl67eyd',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118586554',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'kia',
'make_model': 'kia sportage estate',
'model': 'sportage estate',
'odometer': 131475,
'odometer_in_km': 211587,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-18',
'sanitized_make': 'kia',
'seller_name': 'startline motor finance ltd',
'title': 'kia sportage estate 1.6 gdi isg 2 5dr',
'transmission': 'manual',
'trim': '1.6 gdi isg 2 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 4227fc2f-0a51-5473-926d-b690a3dc33c7 spider: astonbarclay.gb
2026-01-28 19:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4227fc2f-0a51-5473-926d-b690a3dc33c7 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'kia sportage estate 1.6 gdi isg 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sportage estate', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 131475, 'odometer_reading_unit': 'mi', 'registration_date': '2018-01-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118586554', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 gdi isg 2 5dr', 'license_plate': 'yl67eyd', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 147, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '4227fc2f-0a51-5473-926d-b690a3dc33c7', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'kia sportage estate', 'sanitized_make': 'kia', 'odometer_in_km': 211587}
Failed validating None in schema:
False
On instance:
{'age_in_months': 96,
'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'petrol',
'id': '4227fc2f-0a51-5473-926d-b690a3dc33c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'yl67eyd',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118586554',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'kia',
'make_model': 'kia sportage estate',
'model': 'sportage estate',
'odometer': 131475,
'odometer_in_km': 211587,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-18',
'sanitized_make': 'kia',
'seller_name': 'startline motor finance ltd',
'title': 'kia sportage estate 1.6 gdi isg 2 5dr',
'transmission': 'manual',
'trim': '1.6 gdi isg 2 5dr',
'vin': None,
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '4227fc2f-0a51-5473-926d-b690a3dc33c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YL67EYD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118586554',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'KIA',
'model': 'SPORTAGE ESTATE',
'odometer': 131475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-18',
'seller_name': 'Startline Motor Finance Ltd',
'title': 'KIA SPORTAGE ESTATE 1.6 GDi ISG 2 5dr',
'transmission': 'manual',
'trim': '1.6 GDi ISG 2 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118586554%27 HTTP/1.1" 200 None
2026-01-28 19:01:16 [astonbarclay.gb] INFO: Saving data for 118586554: {'auction_closing_time': 1769774400.0, 'created_time': 1768417486.249758, 'last_price_update_time': 1769626876.469927}
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118586554') HTTP/1.1" 204 0
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904db290>
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Ffa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190196310>
2026-01-28 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fc8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c0b10>
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F158594b3-5127-4a74-a256-6f835724120e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190439e90>
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c1e10>
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191849390>
2026-01-28 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 119036653
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036653%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 119036653: 0
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118464369
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118464369%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118464369: 0
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118950223
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950223%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118950223: 1
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fcf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118949019?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118926127?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948972?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948869?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118557481?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 119054522
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054522%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 119054522: 1
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119098860?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948647?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118994797
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994797%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118994797: 1
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fc3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118994826
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994826%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118994826: 1
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118318566
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118318566%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118318566: 0
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118161127
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118161127%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118161127: 0
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 118950190
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950190%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [astonbarclay.gb] INFO: Scrape type for 118950190: 1
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31906231d0>
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fdf36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190295190>
2026-01-28 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a07d10>
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 116134889: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117974688
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117974688%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117974688: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 118657356
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118657356%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 118657356: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 118389670
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118389670%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 118389670: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 118389680
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118389680%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 118389680: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119035108
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035108%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119035108: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119044976
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044976%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119044976: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 118892414
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118892414%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 118892414: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119035263
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035263%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119035263: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119035131
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035131%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119035131: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119045571
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045571%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119045571: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119035093
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035093%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119035093: 0
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 119054500
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054500%27 HTTP/1.1" 200 None
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Scrape type for 119054500: 1
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118949019, 'registration': 'MA19BFO', 'account': 'HAT006', 'make': 'BMW', 'model': 'Z4 ROADSTER', 'derivative': 'sDrive M40i 2dr Auto', 'mileage': 35086, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 2, 'engineSize': 2998, 'bodyType': 'Roadster', 'images': ['https://abimg003.imgix.net/MA19BFO/2026-01-27/image/78d24b8b-03a1-4d1b-8e58-b771d6763556_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/ebbbbef6-dc06-4d20-b0e2-3ce40420d4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/ca0c267e-498a-4ca6-9b10-20ff01bd1364_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/53b07063-121c-48d0-8b01-d196a79bbf42_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/0f6f32b6-2ddf-4b8f-8982-2781f648e15a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/3c69e1e1-7e23-4f5a-a30c-9a3822d77323_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/926ba638-ab34-4399-9123-dc4327e447c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/2903a1a2-0831-4472-999d-76969ae57172_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/5da308c8-d6cc-4eca-9022-f78acc8d8dd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/f67e63cb-993b-442a-9dc5-eb365c15ded3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/22 - 65K, 09/24 - NO MILEAGE, 01/25 - 78K,', 'remarks': '**75** VOSA STATES 13K, 16K, 22K, 25K, 26K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd5b9a2c-2758-4bcb-96b0-7dfc4df45b53.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118949019, 'registration': 'MA19BFO', 'account': 'HAT006', 'make': 'BMW', 'model': 'Z4 ROADSTER', 'derivative': 'sDrive M40i 2dr Auto', 'mileage': 35086, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 2, 'engineSize': 2998, 'bodyType': 'Roadster', 'images': ['https://abimg003.imgix.net/MA19BFO/2026-01-27/image/78d24b8b-03a1-4d1b-8e58-b771d6763556_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/ebbbbef6-dc06-4d20-b0e2-3ce40420d4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/ca0c267e-498a-4ca6-9b10-20ff01bd1364_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/53b07063-121c-48d0-8b01-d196a79bbf42_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/0f6f32b6-2ddf-4b8f-8982-2781f648e15a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/3c69e1e1-7e23-4f5a-a30c-9a3822d77323_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/926ba638-ab34-4399-9123-dc4327e447c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/2903a1a2-0831-4472-999d-76969ae57172_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/5da308c8-d6cc-4eca-9022-f78acc8d8dd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA19BFO/2026-01-27/image/f67e63cb-993b-442a-9dc5-eb365c15ded3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/22 - 65K, 09/24 - NO MILEAGE, 01/25 - 78K,', 'remarks': '**75** VOSA STATES 13K, 16K, 22K, 25K, 26K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd5b9a2c-2758-4bcb-96b0-7dfc4df45b53.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05eb4d44-4abd-50bc-aa86-82af6da52986 with identifier: 118949019
2026-01-28 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05eb4d44-4abd-50bc-aa86-82af6da52986 with scrape type 2
2026-01-28 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05eb4d44-4abd-50bc-aa86-82af6da52986 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05eb4d44-4abd-50bc-aa86-82af6da52986, identifier: 118949019
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118926127, 'registration': 'CA18EDX', 'account': 'MOT075', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 TDCi 120 ST-Line Navigation 5dr', 'mileage': 94249, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CA18EDX/2026-01-23/image/55c32c41-5f01-4013-95ff-e4eeb073b7af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/a69fddcb-1f34-489d-a107-d5210bdc557a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/6eaf4e3b-e6ce-4ed7-a4fe-a1b1e2c5a8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/948e0340-98b6-4a3d-a05b-88561256ec2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/95bbd40e-6051-498b-a3f9-8c685530cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/94dd354e-507d-46c9-ab9e-3967a16e370f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/d6cf777e-4968-46f8-aaf3-4f7ea14137ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/9a968541-9186-4e25-b1b7-e12f38657c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/b3160832-7306-40db-bc6c-d2f7f5d1bf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/78d327ca-4462-44aa-8a69-368c90d1de1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/64e4102c-5582-4891-8c2a-e6efca513bf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/23efee19-1616-45e3-a687-51f9a81104d8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 39K, 57K, 67K, 81K OUTSTANDING RECALL.', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c23c2449-5ac8-4e21-82a9-f41a65c0e029.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118926127, 'registration': 'CA18EDX', 'account': 'MOT075', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 TDCi 120 ST-Line Navigation 5dr', 'mileage': 94249, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CA18EDX/2026-01-23/image/55c32c41-5f01-4013-95ff-e4eeb073b7af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/a69fddcb-1f34-489d-a107-d5210bdc557a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/6eaf4e3b-e6ce-4ed7-a4fe-a1b1e2c5a8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/948e0340-98b6-4a3d-a05b-88561256ec2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/95bbd40e-6051-498b-a3f9-8c685530cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/94dd354e-507d-46c9-ab9e-3967a16e370f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/d6cf777e-4968-46f8-aaf3-4f7ea14137ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/9a968541-9186-4e25-b1b7-e12f38657c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/b3160832-7306-40db-bc6c-d2f7f5d1bf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/78d327ca-4462-44aa-8a69-368c90d1de1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/64e4102c-5582-4891-8c2a-e6efca513bf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA18EDX/2026-01-23/image/23efee19-1616-45e3-a687-51f9a81104d8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 39K, 57K, 67K, 81K OUTSTANDING RECALL.', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c23c2449-5ac8-4e21-82a9-f41a65c0e029.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c529d1c2-6efd-581b-8108-1b7b4ed62806 with identifier: 118926127
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c529d1c2-6efd-581b-8108-1b7b4ed62806 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c529d1c2-6efd-581b-8108-1b7b4ed62806 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c529d1c2-6efd-581b-8108-1b7b4ed62806, identifier: 118926127
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948972, 'registration': 'RO17JHZ', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q2 DIESEL ESTATE', 'derivative': '2.0 TDI Quattro S Line 5dr S Tronic', 'mileage': 72462, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-26', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/0fc3645d-db08-4f28-861b-2e5018ec7c0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/aff46683-2636-4e4d-8acf-c9175e799dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/0941d665-604d-4570-bec7-104e990a2739_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/1e03d739-384f-40bb-8080-9e74bfb42074_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/bd9e8038-429f-4c53-8617-777463668edd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/2a3d602b-78e3-4725-b7ea-c6f2ed1cc030_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/88141beb-8203-4c4e-a3a7-863cac617e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/f4c6b38e-9fa6-4c44-aaff-967b6883e97a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/e7796080-134d-45aa-b83b-c8f8ef37ee37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 - 20K, 03/20 - NO MILEAGE, 03/21 - 41K, 01/24 - 61K,', 'remarks': '**40** VOSA STATES 33K, 41K, 46K, 51K, 61K, 66K, 72K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a80a0ef9-f590-4d41-bd9c-5576d92e3f43.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948972, 'registration': 'RO17JHZ', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q2 DIESEL ESTATE', 'derivative': '2.0 TDI Quattro S Line 5dr S Tronic', 'mileage': 72462, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-26', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/0fc3645d-db08-4f28-861b-2e5018ec7c0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/aff46683-2636-4e4d-8acf-c9175e799dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/0941d665-604d-4570-bec7-104e990a2739_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/1e03d739-384f-40bb-8080-9e74bfb42074_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/bd9e8038-429f-4c53-8617-777463668edd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/2a3d602b-78e3-4725-b7ea-c6f2ed1cc030_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/88141beb-8203-4c4e-a3a7-863cac617e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/f4c6b38e-9fa6-4c44-aaff-967b6883e97a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO17JHZ/2026-01-27/image/e7796080-134d-45aa-b83b-c8f8ef37ee37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 - 20K, 03/20 - NO MILEAGE, 03/21 - 41K, 01/24 - 61K,', 'remarks': '**40** VOSA STATES 33K, 41K, 46K, 51K, 61K, 66K, 72K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a80a0ef9-f590-4d41-bd9c-5576d92e3f43.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a00247d-79b2-5ca0-b436-515b4a15572c with identifier: 118948972
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a00247d-79b2-5ca0-b436-515b4a15572c with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a00247d-79b2-5ca0-b436-515b4a15572c with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9a00247d-79b2-5ca0-b436-515b4a15572c, identifier: 118948972
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948869, 'registration': 'CK67VJG', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 SE 5dr Auto', 'mileage': 88252, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-15', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/CK67VJG/2026-01-28/image/2fdbfca6-58e9-4061-a2fd-3c9f49e08096_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/7fc02b29-cd19-41a2-8e06-c3ebce9f87e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/b2fb0946-6521-43ee-baeb-d37cba4eb725_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/41939b71-1258-49e7-9349-fc3b9b02e424_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/76ef9cc5-1450-40c2-b60e-17a773930a93_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/ad12bcbb-bc1d-4ecd-b5bb-ed43f5064b64_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/92b7d4c8-2711-4853-8a79-719981bfd058_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/61ee7330-ceb3-4b71-bcc7-de2d6cdf7a37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/4206d26c-e466-4c70-b877-09ba6f86f2d6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/19- 12K', 'remarks': '**76**VOSA STATES 28K, 38K, 50K, 63K, 75K, 87K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/413ee557-0365-4893-b09b-bbc4b5d0ab05.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948869, 'registration': 'CK67VJG', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 SE 5dr Auto', 'mileage': 88252, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-15', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/CK67VJG/2026-01-28/image/2fdbfca6-58e9-4061-a2fd-3c9f49e08096_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/7fc02b29-cd19-41a2-8e06-c3ebce9f87e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/b2fb0946-6521-43ee-baeb-d37cba4eb725_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/41939b71-1258-49e7-9349-fc3b9b02e424_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/76ef9cc5-1450-40c2-b60e-17a773930a93_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/ad12bcbb-bc1d-4ecd-b5bb-ed43f5064b64_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/92b7d4c8-2711-4853-8a79-719981bfd058_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/61ee7330-ceb3-4b71-bcc7-de2d6cdf7a37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK67VJG/2026-01-28/image/4206d26c-e466-4c70-b877-09ba6f86f2d6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/19- 12K', 'remarks': '**76**VOSA STATES 28K, 38K, 50K, 63K, 75K, 87K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/413ee557-0365-4893-b09b-bbc4b5d0ab05.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34399834-39b7-5912-af51-5a21758f49a9 with identifier: 118948869
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34399834-39b7-5912-af51-5a21758f49a9 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34399834-39b7-5912-af51-5a21758f49a9 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 34399834-39b7-5912-af51-5a21758f49a9, identifier: 118948869
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118557481, 'registration': 'KR66EBF', 'account': 'WBA004', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI CR vRS 5dr DSG 4x4', 'mileage': 129454, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-11-22', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR66EBF/2026-01-14/image/333eff98-680a-4ddf-9a54-1635171ed482_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/37e21905-3cf5-4e98-a668-2e17aee8e19e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/8f366e55-e65c-407b-99b3-9003d634adfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/1ad73d48-84f7-4e6d-b545-b191ef965b7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/e6c42eb0-6eec-4b73-aeed-db92c35e344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/9af3f890-fb44-4e09-a1b3-77e885c0f3df_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/66a66653-72c1-47dd-8bf3-9eb85bea704d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/daa656f9-55b0-4c5e-886e-83860ac2ccfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/e4e322f8-e7d2-48c9-a9ad-8b37a9c0fe0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/24 - 115K, 08/24 - 120K, 11/24 - 121K, 01/25 - 120K, 08/25 - 125K, 01/26 - 129K DISCREPANCY ON PRINT', 'remarks': '**681** VOSA STATES 47K, 68K, 83K, 103K, 115K, 120K, 128K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b67e54e2-28a2-413a-b841-4bcc540732b5.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118557481, 'registration': 'KR66EBF', 'account': 'WBA004', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI CR vRS 5dr DSG 4x4', 'mileage': 129454, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-11-22', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR66EBF/2026-01-14/image/333eff98-680a-4ddf-9a54-1635171ed482_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/37e21905-3cf5-4e98-a668-2e17aee8e19e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/8f366e55-e65c-407b-99b3-9003d634adfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/1ad73d48-84f7-4e6d-b545-b191ef965b7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/e6c42eb0-6eec-4b73-aeed-db92c35e344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/9af3f890-fb44-4e09-a1b3-77e885c0f3df_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/66a66653-72c1-47dd-8bf3-9eb85bea704d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/daa656f9-55b0-4c5e-886e-83860ac2ccfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR66EBF/2026-01-14/image/e4e322f8-e7d2-48c9-a9ad-8b37a9c0fe0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/24 - 115K, 08/24 - 120K, 11/24 - 121K, 01/25 - 120K, 08/25 - 125K, 01/26 - 129K DISCREPANCY ON PRINT', 'remarks': '**681** VOSA STATES 47K, 68K, 83K, 103K, 115K, 120K, 128K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b67e54e2-28a2-413a-b841-4bcc540732b5.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf861b93-fbc8-524c-9df6-ad69ebca4912 with identifier: 118557481
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf861b93-fbc8-524c-9df6-ad69ebca4912 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf861b93-fbc8-524c-9df6-ad69ebca4912 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf861b93-fbc8-524c-9df6-ad69ebca4912, identifier: 118557481
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190339010>
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119098860, 'registration': 'SF19HAC', 'account': 'KTL001', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 2 5dr', 'mileage': 128309, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 07/20 - 5K, 11/21 - 12K, 02/22 - 13K, 11/23 - 72K, 11/24 - 107K,', 'remarks': '**1715** VOSA STATES 13K, 72K, 107K,', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119098860, 'registration': 'SF19HAC', 'account': 'KTL001', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 2 5dr', 'mileage': 128309, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 07/20 - 5K, 11/21 - 12K, 02/22 - 13K, 11/23 - 72K, 11/24 - 107K,', 'remarks': '**1715** VOSA STATES 13K, 72K, 107K,', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 with identifier: 119098860
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 with scrape type 1
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430, identifier: 119098860
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948647, 'registration': 'LK66LLA', 'account': 'HAT006', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d Portfolio 5dr Auto AWD', 'mileage': 81040, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-10', 'fuel': 'Diesel', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LK66LLA/2026-01-28/image/06670c32-37ee-43c3-b7ac-488f6d84158d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/3e9c0964-6a20-4c98-817b-92edef2b3ca9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/0f456633-d0cc-438e-baf9-9dbfdab32960_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/f4f9289d-84c7-4363-83d6-36f700a32438_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/f50e7b41-2680-4608-8c4e-0137d4a157e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/8c3233b6-e65b-4055-ba75-7e68b24ac82c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/8d6dce55-7252-4e51-8b57-ce7bedc2a79b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/0f611b67-3db1-429c-80d0-5963d6a07ab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/1f896239-fbda-49f0-beea-c3a961387601_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/18- 13K, 06/20- 26K, 06/23- 59K,', 'remarks': '**39**VOSA STATES 19K, 26K, 34K, 47K, 59K, 69K, 77K, SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1a7403e-b1f1-46a3-9bc2-f18043cff5d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948647, 'registration': 'LK66LLA', 'account': 'HAT006', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d Portfolio 5dr Auto AWD', 'mileage': 81040, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-10', 'fuel': 'Diesel', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LK66LLA/2026-01-28/image/06670c32-37ee-43c3-b7ac-488f6d84158d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/3e9c0964-6a20-4c98-817b-92edef2b3ca9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/0f456633-d0cc-438e-baf9-9dbfdab32960_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/f4f9289d-84c7-4363-83d6-36f700a32438_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/f50e7b41-2680-4608-8c4e-0137d4a157e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/8c3233b6-e65b-4055-ba75-7e68b24ac82c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/8d6dce55-7252-4e51-8b57-ce7bedc2a79b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/0f611b67-3db1-429c-80d0-5963d6a07ab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LK66LLA/2026-01-28/image/1f896239-fbda-49f0-beea-c3a961387601_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/18- 13K, 06/20- 26K, 06/23- 59K,', 'remarks': '**39**VOSA STATES 19K, 26K, 34K, 47K, 59K, 69K, 77K, SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1a7403e-b1f1-46a3-9bc2-f18043cff5d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a63295b8-2a0b-5ce1-8907-25412fd50475 with identifier: 118948647
2026-01-28 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a63295b8-2a0b-5ce1-8907-25412fd50475 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a63295b8-2a0b-5ce1-8907-25412fd50475 with scrape type 2
2026-01-28 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a63295b8-2a0b-5ce1-8907-25412fd50475, identifier: 118948647
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 118950178
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950178%27 HTTP/1.1" 200 None
2026-01-28 19:01:20 [astonbarclay.gb] INFO: Scrape type for 118950178: 1
2026-01-28 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118923468?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05eb4d44-4abd-50bc-aa86-82af6da52986 with identifier: 118949019
2026-01-28 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05eb4d44-4abd-50bc-aa86-82af6da52986 with identifier: 118949019
2026-01-28 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 05eb4d44-4abd-50bc-aa86-82af6da52986 with identifier: 118949019 to the API
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2705eb4d44-4abd-50bc-aa86-82af6da52986%27 HTTP/1.1" 200 None
2026-01-28 19:01:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 05eb4d44-4abd-50bc-aa86-82af6da52986: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118949019?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 168,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Petrol',
'id': '05eb4d44-4abd-50bc-aa86-82af6da52986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MA19BFO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118949019',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': 'Z4 ROADSTER',
'odometer': 35086,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-18',
'seller_name': 'Hatfields Group',
'title': 'BMW Z4 ROADSTER sDrive M40i 2dr Auto',
'transmission': 'automatic',
'trim': 'sDrive M40i 2dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118949019%27 HTTP/1.1" 200 None
2026-01-28 19:01:21 [astonbarclay.gb] INFO: Saving data for 118949019: {'auction_closing_time': 1770123600.0, 'created_time': 1769194990.958965, 'last_price_update_time': 1769626881.185764}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118949019') HTTP/1.1" 204 0
2026-01-28 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c529d1c2-6efd-581b-8108-1b7b4ed62806 with identifier: 118926127
2026-01-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c529d1c2-6efd-581b-8108-1b7b4ed62806 with identifier: 118926127
2026-01-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151678 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151678
2026-01-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c529d1c2-6efd-581b-8108-1b7b4ed62806 spider: astonbarclay.gb
2026-01-28 19:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c529d1c2-6efd-581b-8108-1b7b4ed62806 due to rule: high_mileage_for_country.json, error: 151678 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151678
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': 'c529d1c2-6efd-581b-8108-1b7b4ed62806',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'CA18EDX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118926127',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'FOCUS DIESEL HATCHBACK',
'odometer': 94249,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': 'MotoNovo Finance',
'title': 'FORD FOCUS DIESEL HATCHBACK 1.5 TDCi 120 ST-Line Navigation 5dr',
'transmission': 'manual',
'trim': '1.5 TDCi 120 ST-Line Navigation 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118926127%27 HTTP/1.1" 200 None
2026-01-28 19:01:21 [astonbarclay.gb] INFO: Saving data for 118926127: {'auction_closing_time': 1769774400.0, 'created_time': 1769158999.512493, 'last_price_update_time': 1769626881.524793}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118926127') HTTP/1.1" 204 0
2026-01-28 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9a00247d-79b2-5ca0-b436-515b4a15572c with identifier: 118948972
2026-01-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9a00247d-79b2-5ca0-b436-515b4a15572c with identifier: 118948972
2026-01-28 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9a00247d-79b2-5ca0-b436-515b4a15572c with identifier: 118948972 to the API
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279a00247d-79b2-5ca0-b436-515b4a15572c%27 HTTP/1.1" 200 None
2026-01-28 19:01:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9a00247d-79b2-5ca0-b436-515b4a15572c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118948972?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '9a00247d-79b2-5ca0-b436-515b4a15572c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RO17JHZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948972',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'AUDI',
'model': 'Q2 DIESEL ESTATE',
'odometer': 72462,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-31',
'seller_name': 'Hatfields Group',
'title': 'AUDI Q2 DIESEL ESTATE 2.0 TDI Quattro S Line 5dr S Tronic',
'transmission': 'automatic',
'trim': '2.0 TDI Quattro S Line 5dr S Tronic',
'vin': None,
'year': 2017}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948972%27 HTTP/1.1" 200 None
2026-01-28 19:01:21 [astonbarclay.gb] INFO: Saving data for 118948972: {'auction_closing_time': 1770123600.0, 'created_time': 1769194999.419554, 'last_price_update_time': 1769626881.904212}
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948972') HTTP/1.1" 204 0
2026-01-28 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 34399834-39b7-5912-af51-5a21758f49a9 with identifier: 118948869
2026-01-28 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 34399834-39b7-5912-af51-5a21758f49a9 with identifier: 118948869
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142027 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
142027
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 34399834-39b7-5912-af51-5a21758f49a9 spider: astonbarclay.gb
2026-01-28 19:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 34399834-39b7-5912-af51-5a21758f49a9 due to rule: high_mileage_for_make.json, error: 142027 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
142027
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '34399834-39b7-5912-af51-5a21758f49a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'CK67VJG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948869',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'DISCOVERY DIESEL SW',
'odometer': 88252,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 TD6 SE 5dr Auto',
'transmission': 'automatic',
'trim': '3.0 TD6 SE 5dr Auto',
'vin': None,
'year': 2018}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948869%27 HTTP/1.1" 200 None
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Saving data for 118948869: {'auction_closing_time': 1770123600.0, 'created_time': 1769195001.388831, 'last_price_update_time': 1769626882.122334}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948869') HTTP/1.1" 204 0
2026-01-28 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf861b93-fbc8-524c-9df6-ad69ebca4912 with identifier: 118557481
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf861b93-fbc8-524c-9df6-ad69ebca4912 with identifier: 118557481
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'skoda octavia diesel estate 2.0 tdi cr vrs 5dr dsg 4x4', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 129454, 'odometer_reading_unit': 'mi', 'registration_date': '2016-11-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118557481', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg 4x4', 'license_plate': 'kr66ebf', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 131, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'bf861b93-fbc8-524c-9df6-ad69ebca4912', 'current_year_diff': 10, 'age_in_months': 110, 'make_model': 'skoda octavia diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 208335}
Failed validating None in schema:
False
On instance:
{'age_in_months': 110,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': 'bf861b93-fbc8-524c-9df6-ad69ebca4912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'kr66ebf',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118557481',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'skoda',
'make_model': 'skoda octavia diesel estate',
'model': 'octavia diesel estate',
'odometer': 129454,
'odometer_in_km': 208335,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-22',
'sanitized_make': 'skoda',
'seller_name': 'ukcgr - trade',
'title': 'skoda octavia diesel estate 2.0 tdi cr vrs 5dr dsg 4x4',
'transmission': 'automatic',
'trim': '2.0 tdi cr vrs 5dr dsg 4x4',
'vin': None,
'year': 2016}
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: bf861b93-fbc8-524c-9df6-ad69ebca4912 spider: astonbarclay.gb
2026-01-28 19:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bf861b93-fbc8-524c-9df6-ad69ebca4912 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'skoda octavia diesel estate 2.0 tdi cr vrs 5dr dsg 4x4', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 129454, 'odometer_reading_unit': 'mi', 'registration_date': '2016-11-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118557481', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg 4x4', 'license_plate': 'kr66ebf', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 131, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'bf861b93-fbc8-524c-9df6-ad69ebca4912', 'current_year_diff': 10, 'age_in_months': 110, 'make_model': 'skoda octavia diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 208335}
Failed validating None in schema:
False
On instance:
{'age_in_months': 110,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 10,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': 'bf861b93-fbc8-524c-9df6-ad69ebca4912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'kr66ebf',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118557481',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'skoda',
'make_model': 'skoda octavia diesel estate',
'model': 'octavia diesel estate',
'odometer': 129454,
'odometer_in_km': 208335,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-22',
'sanitized_make': 'skoda',
'seller_name': 'ukcgr - trade',
'title': 'skoda octavia diesel estate 2.0 tdi cr vrs 5dr dsg 4x4',
'transmission': 'automatic',
'trim': '2.0 tdi cr vrs 5dr dsg 4x4',
'vin': None,
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': 'bf861b93-fbc8-524c-9df6-ad69ebca4912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KR66EBF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118557481',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'SKODA',
'model': 'OCTAVIA DIESEL ESTATE',
'odometer': 129454,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-22',
'seller_name': 'UKCGR - Trade',
'title': 'SKODA OCTAVIA DIESEL ESTATE 2.0 TDI CR vRS 5dr DSG 4x4',
'transmission': 'automatic',
'trim': '2.0 TDI CR vRS 5dr DSG 4x4',
'vin': None,
'year': 2016}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118557481%27 HTTP/1.1" 200 None
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Saving data for 118557481: {'auction_closing_time': 1769774400.0, 'created_time': 1768331699.700263, 'last_price_update_time': 1769626882.417522}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118557481') HTTP/1.1" 204 0
2026-01-28 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 with identifier: 119098860
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 with identifier: 119098860
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kia specialist', 'price_includes_vat': False, 'title': 'kia rio hatchback 1.0 t gdi 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'rio hatchback', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 128309, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098860', 'expiration_date': '2026-02-03t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.0 t gdi 2 5dr', 'license_plate': 'sf19hac', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 114, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '97b4bf0a-a1de-56b6-ab27-e92e5ffd1430', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'kia rio hatchback', 'sanitized_make': 'kia', 'odometer_in_km': 206492}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.0l',
'expiration_date': '2026-02-03t13:00:00z',
'fuel_type': 'petrol',
'id': '97b4bf0a-a1de-56b6-ab27-e92e5ffd1430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'sf19hac',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098860',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'kia',
'make_model': 'kia rio hatchback',
'model': 'rio hatchback',
'odometer': 128309,
'odometer_in_km': 206492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-29',
'sanitized_make': 'kia',
'seller_name': 'kia specialist',
'title': 'kia rio hatchback 1.0 t gdi 2 5dr',
'transmission': 'manual',
'trim': '1.0 t gdi 2 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 spider: astonbarclay.gb
2026-01-28 19:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 97b4bf0a-a1de-56b6-ab27-e92e5ffd1430 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kia specialist', 'price_includes_vat': False, 'title': 'kia rio hatchback 1.0 t gdi 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'rio hatchback', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 128309, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098860', 'expiration_date': '2026-02-03t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.0 t gdi 2 5dr', 'license_plate': 'sf19hac', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 114, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '97b4bf0a-a1de-56b6-ab27-e92e5ffd1430', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'kia rio hatchback', 'sanitized_make': 'kia', 'odometer_in_km': 206492}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.0l',
'expiration_date': '2026-02-03t13:00:00z',
'fuel_type': 'petrol',
'id': '97b4bf0a-a1de-56b6-ab27-e92e5ffd1430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'sf19hac',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098860',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'kia',
'make_model': 'kia rio hatchback',
'model': 'rio hatchback',
'odometer': 128309,
'odometer_in_km': 206492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-29',
'sanitized_make': 'kia',
'seller_name': 'kia specialist',
'title': 'kia rio hatchback 1.0 t gdi 2 5dr',
'transmission': 'manual',
'trim': '1.0 t gdi 2 5dr',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Petrol',
'id': '97b4bf0a-a1de-56b6-ab27-e92e5ffd1430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SF19HAC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119098860',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'KIA',
'model': 'RIO HATCHBACK',
'odometer': 128309,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-29',
'seller_name': 'Kia Specialist',
'title': 'KIA RIO HATCHBACK 1.0 T GDi 2 5dr',
'transmission': 'manual',
'trim': '1.0 T GDi 2 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119098860%27 HTTP/1.1" 200 None
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Saving data for 119098860: {'created_time': 1769626882.632022, 'last_price_update_time': 1769626882.632032, 'auction_closing_time': 1770123600.0}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119098860') HTTP/1.1" 204 0
2026-01-28 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a63295b8-2a0b-5ce1-8907-25412fd50475 with identifier: 118948647
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a63295b8-2a0b-5ce1-8907-25412fd50475 with identifier: 118948647
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: a63295b8-2a0b-5ce1-8907-25412fd50475 spider: astonbarclay.gb
2026-01-28 19:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a63295b8-2a0b-5ce1-8907-25412fd50475 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': 'a63295b8-2a0b-5ce1-8907-25412fd50475',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LK66LLA',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948647',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'JAGUAR',
'model': 'F-PACE DIESEL ESTATE',
'odometer': 81040,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-10',
'seller_name': 'Hatfields Group',
'title': 'JAGUAR F-PACE DIESEL ESTATE 2.0d Portfolio 5dr Auto AWD',
'transmission': 'automatic',
'trim': '2.0d Portfolio 5dr Auto AWD',
'vin': None,
'year': 2016}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948647%27 HTTP/1.1" 200 None
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Saving data for 118948647: {'auction_closing_time': 1770123600.0, 'created_time': 1769195025.869373, 'last_price_update_time': 1769626882.844799}
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948647') HTTP/1.1" 204 0
2026-01-28 19:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 118723655
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723655%27 HTTP/1.1" 200 None
2026-01-28 19:01:22 [astonbarclay.gb] INFO: Scrape type for 118723655: 1
2026-01-28 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190105cd0>
2026-01-28 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190115d50>
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190108050>
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190108310>
2026-01-28 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319010c050>
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319011e950>
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252F49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319010ca10>
2026-01-28 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 119045843
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045843%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 119045843: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118723618
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723618%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118723618: 1
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118950223?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118923468, 'registration': 'PK22YPJ', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D200 R-Dynamic HSE 5dr Auto', 'mileage': 41000, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-22', 'fuel': 'Diesel', 'motExpiry': '2026-04-21', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 39K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118923468, 'registration': 'PK22YPJ', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D200 R-Dynamic HSE 5dr Auto', 'mileage': 41000, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-22', 'fuel': 'Diesel', 'motExpiry': '2026-04-21', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 39K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728f501f-18bf-533a-b2b8-9a1654c8daa5 with identifier: 118923468
2026-01-28 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728f501f-18bf-533a-b2b8-9a1654c8daa5 with scrape type 2
2026-01-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 728f501f-18bf-533a-b2b8-9a1654c8daa5 with scrape type 2
2026-01-28 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 728f501f-18bf-533a-b2b8-9a1654c8daa5, identifier: 118923468
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118923512?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118432035?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118741643?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 728f501f-18bf-533a-b2b8-9a1654c8daa5 with identifier: 118923468
2026-01-28 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 728f501f-18bf-533a-b2b8-9a1654c8daa5 with identifier: 118923468
2026-01-28 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 728f501f-18bf-533a-b2b8-9a1654c8daa5 with identifier: 118923468 to the API
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27728f501f-18bf-533a-b2b8-9a1654c8daa5%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 728f501f-18bf-533a-b2b8-9a1654c8daa5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118923468?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '728f501f-18bf-533a-b2b8-9a1654c8daa5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'PK22YPJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118923468',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-22',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 D200 R-Dynamic '
'HSE 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 D200 R-Dynamic HSE 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923468%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Saving data for 118923468: {'auction_closing_time': 1770123600.0, 'created_time': 1769195010.592186, 'last_price_update_time': 1769626885.497157}
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118923468') HTTP/1.1" 204 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 119036632
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036632%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 119036632: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118713943
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118713943%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118713943: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118990952
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990952%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118990952: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118982254
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118982254%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118982254: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118977168
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118977168%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118977168: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118989725
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989725%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118989725: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118991837
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991837%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118991837: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118990906
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990906%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118990906: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118984889
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118984889%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118984889: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118918637
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918637%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118918637: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 118957662
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118957662%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 118957662: 0
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 119053712
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053712%27 HTTP/1.1" 200 None
2026-01-28 19:01:25 [astonbarclay.gb] INFO: Scrape type for 119053712: 1
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a7390>
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901968d0>
2026-01-28 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190277890>
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_12.jpg HTTP/1.1" 201 0
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190324350>
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fcf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190365c90>
2026-01-28 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_13.jpg HTTP/1.1" 201 0
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190324690>
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_11.jpg HTTP/1.1" 201 0
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fc3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118950223, 'registration': 'HT16EJU', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique Nav 5dr', 'mileage': 52970, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-24', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b05aa136-acfa-4450-8ba9-1618c58c5537.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118950223, 'registration': 'HT16EJU', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique Nav 5dr', 'mileage': 52970, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-24', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b05aa136-acfa-4450-8ba9-1618c58c5537.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f90f5ee-6168-503f-add2-03aadc56e2f5 with identifier: 118950223
2026-01-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f90f5ee-6168-503f-add2-03aadc56e2f5 with scrape type 1
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7f90f5ee-6168-503f-add2-03aadc56e2f5
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7f90f5ee-6168-503f-add2-03aadc56e2f5
2026-01-28 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7f90f5ee-6168-503f-add2-03aadc56e2f5, identifier: 118950223
2026-01-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 118994757
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994757%27 HTTP/1.1" 200 None
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Scrape type for 118994757: 0
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 119029737
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119029737%27 HTTP/1.1" 200 None
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Scrape type for 119029737: 1
2026-01-28 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7f90f5ee-6168-503f-add2-03aadc56e2f5 with identifier: 118950223
2026-01-28 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7f90f5ee-6168-503f-add2-03aadc56e2f5 with identifier: 118950223
2026-01-28 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 7f90f5ee-6168-503f-add2-03aadc56e2f5 spider: astonbarclay.gb
2026-01-28 19:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7f90f5ee-6168-503f-add2-03aadc56e2f5 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '7f90f5ee-6168-503f-add2-03aadc56e2f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'HT16EJU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118950223',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'RENAULT',
'model': 'CAPTUR HATCHBACK',
'odometer': 52970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-24',
'seller_name': 'Wilsons',
'title': 'RENAULT CAPTUR HATCHBACK 0.9 TCE 90 Dynamique Nav 5dr',
'transmission': 'manual',
'trim': '0.9 TCE 90 Dynamique Nav 5dr',
'vin': None,
'year': 2016}
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950223%27 HTTP/1.1" 200 None
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Saving data for 118950223: {'created_time': 1769626887.781356, 'last_price_update_time': 1769626887.781366, 'auction_closing_time': 1770198300.0}
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118950223') HTTP/1.1" 204 0
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118940557, 'registration': 'BV21FTE', 'account': 'INT016', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 92753, 'mileageWarranty': False, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Electric', 'motExpiry': '2026-06-29', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Interbay Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/591382fd-8fa5-42d5-9cbc-f5434485b287.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118940557, 'registration': 'BV21FTE', 'account': 'INT016', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 92753, 'mileageWarranty': False, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Electric', 'motExpiry': '2026-06-29', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Interbay Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/591382fd-8fa5-42d5-9cbc-f5434485b287.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f with identifier: 118940557
2026-01-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f with scrape type 1
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118724798, 'registration': 'GX72POV', 'account': 'INT016', 'make': 'MERCEDES-BENZ', 'model': 'EQB ESTATE', 'derivative': 'EQB 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto', 'mileage': 51695, 'mileageWarranty': False, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-12-23', 'fuel': 'Electric', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/23 15K 08/24 25K 06/25 40K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Interbay Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99606fcc-360d-4bb9-9b97-34731b161e03.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118724798, 'registration': 'GX72POV', 'account': 'INT016', 'make': 'MERCEDES-BENZ', 'model': 'EQB ESTATE', 'derivative': 'EQB 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto', 'mileage': 51695, 'mileageWarranty': False, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-12-23', 'fuel': 'Electric', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/23 15K 08/24 25K 06/25 40K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Interbay Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99606fcc-360d-4bb9-9b97-34731b161e03.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09433e2c-d8d3-5982-b321-83c1f25746ff with identifier: 118724798
2026-01-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09433e2c-d8d3-5982-b321-83c1f25746ff with scrape type 1
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Fd0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118923512, 'registration': 'PK20ATX', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D150 S 5dr 2WD', 'mileage': 19823, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-03-13', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 01/23- 10K, 11/24- 16K, 12/24- 16K', 'remarks': '**80**VOSA STATES 10K, 13K, 16K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118923512, 'registration': 'PK20ATX', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D150 S 5dr 2WD', 'mileage': 19823, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-03-13', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 01/23- 10K, 11/24- 16K, 12/24- 16K', 'remarks': '**80**VOSA STATES 10K, 13K, 16K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b965ddc-c230-54bc-b3e4-782751191eac with identifier: 118923512
2026-01-28 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b965ddc-c230-54bc-b3e4-782751191eac with scrape type 2
2026-01-28 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b965ddc-c230-54bc-b3e4-782751191eac with scrape type 2
2026-01-28 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1b965ddc-c230-54bc-b3e4-782751191eac, identifier: 118923512
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118432035, 'registration': 'FX69CAV', 'account': '442001', 'make': 'KIA', 'model': 'CEED SPORTSWAGON', 'derivative': '1.0T GDi ISG 2 NAV 5dr', 'mileage': 77380, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-12', 'fuel': 'Petrol', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX69CAV/2026-01-08/image/62785d8f-873c-4606-a0e6-ff7509e42155_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/d5ff55b1-1557-4b1e-90c0-42172a833ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/cd769419-80e6-4592-a795-93dc9a37135c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/125658de-75e6-407e-8d6e-0342e6a9197f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/2629d4c7-cd19-45b1-a828-ddfe13f5fef1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/edde717f-d297-49c0-8e43-aed4e17dfbab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/42ab8262-55d1-44d1-b58f-7b79fec65087_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/f3bddd98-3867-422b-946d-f8d118fe01f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/3db53cbe-5c48-4108-997b-eff2412b21ca_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/20 - 9K, 11/20 - 27K, 07/22 - 29K, 09/22 - 39K, 05/23 - 50K, 03/24 - 61K, 01/25 - 72K', 'remarks': '**1953** VOSA STATES 52K, 66K, 77K, SD CARD', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb3ad534-ae97-43c9-aa8a-01195d1f177c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118432035, 'registration': 'FX69CAV', 'account': '442001', 'make': 'KIA', 'model': 'CEED SPORTSWAGON', 'derivative': '1.0T GDi ISG 2 NAV 5dr', 'mileage': 77380, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-12', 'fuel': 'Petrol', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX69CAV/2026-01-08/image/62785d8f-873c-4606-a0e6-ff7509e42155_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/d5ff55b1-1557-4b1e-90c0-42172a833ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/cd769419-80e6-4592-a795-93dc9a37135c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/125658de-75e6-407e-8d6e-0342e6a9197f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/2629d4c7-cd19-45b1-a828-ddfe13f5fef1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/edde717f-d297-49c0-8e43-aed4e17dfbab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/42ab8262-55d1-44d1-b58f-7b79fec65087_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/f3bddd98-3867-422b-946d-f8d118fe01f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX69CAV/2026-01-08/image/3db53cbe-5c48-4108-997b-eff2412b21ca_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/20 - 9K, 11/20 - 27K, 07/22 - 29K, 09/22 - 39K, 05/23 - 50K, 03/24 - 61K, 01/25 - 72K', 'remarks': '**1953** VOSA STATES 52K, 66K, 77K, SD CARD', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb3ad534-ae97-43c9-aa8a-01195d1f177c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67ca1ac-ccec-52da-8090-837ecc97430b with identifier: 118432035
2026-01-28 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67ca1ac-ccec-52da-8090-837ecc97430b with scrape type 2
2026-01-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e67ca1ac-ccec-52da-8090-837ecc97430b with scrape type 2
2026-01-28 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e67ca1ac-ccec-52da-8090-837ecc97430b, identifier: 118432035
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118741643, 'registration': 'VN67TBO', 'account': 'AVL002', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Passion Premium 2dr Auto', 'mileage': 51318, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-03', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/VN67TBO/2026-01-21/image/3f8b0177-7a1e-410a-a141-edae39d3d42b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/e505f971-0bea-4e3c-bb2c-ec47c983ca89_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/d8aec3b0-0f74-4be3-ad2a-66ce43093df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/ffa11297-3924-434a-b7f3-4c5761fa00b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/a0bf4504-663d-4126-bfe9-735e8be15bd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/52b445cf-0f4a-42aa-9dcb-826a6538f21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/5b6db897-a01f-496f-99bf-60976b41f286_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/02ba655b-d2e4-46e9-84f3-dbaf8a7c9da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/7976eec4-2313-4c1b-92f3-11057f348747_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1532** VOSA STATES 17K, 19K, 20K, 22K, 36K', 'virtual': False, 'seller': 'Advance Vehicle Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/940390a3-d01a-4af2-b442-d3cc955a4d21.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118741643, 'registration': 'VN67TBO', 'account': 'AVL002', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Passion Premium 2dr Auto', 'mileage': 51318, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-03', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/VN67TBO/2026-01-21/image/3f8b0177-7a1e-410a-a141-edae39d3d42b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/e505f971-0bea-4e3c-bb2c-ec47c983ca89_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/d8aec3b0-0f74-4be3-ad2a-66ce43093df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/ffa11297-3924-434a-b7f3-4c5761fa00b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/a0bf4504-663d-4126-bfe9-735e8be15bd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/52b445cf-0f4a-42aa-9dcb-826a6538f21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/5b6db897-a01f-496f-99bf-60976b41f286_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/02ba655b-d2e4-46e9-84f3-dbaf8a7c9da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN67TBO/2026-01-21/image/7976eec4-2313-4c1b-92f3-11057f348747_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1532** VOSA STATES 17K, 19K, 20K, 22K, 36K', 'virtual': False, 'seller': 'Advance Vehicle Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/940390a3-d01a-4af2-b442-d3cc955a4d21.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with identifier: 118741643
2026-01-28 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with scrape type 2
2026-01-28 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with scrape type 2
2026-01-28 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e8f107fc-3544-522e-ab1c-25f2e9c2a7e6, identifier: 118741643
2026-01-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1b965ddc-c230-54bc-b3e4-782751191eac with identifier: 118923512
2026-01-28 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1b965ddc-c230-54bc-b3e4-782751191eac with identifier: 118923512
2026-01-28 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1b965ddc-c230-54bc-b3e4-782751191eac with identifier: 118923512 to the API
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271b965ddc-c230-54bc-b3e4-782751191eac%27 HTTP/1.1" 200 None
2026-01-28 19:01:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1b965ddc-c230-54bc-b3e4-782751191eac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118923512?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '1b965ddc-c230-54bc-b3e4-782751191eac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'PK20ATX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118923512',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
'odometer': 19823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-13',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 D150 S 5dr 2WD',
'transmission': 'manual',
'trim': '2.0 D150 S 5dr 2WD',
'vin': None,
'year': 2020}
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923512%27 HTTP/1.1" 200 None
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Saving data for 118923512: {'auction_closing_time': 1770123600.0, 'created_time': 1769194988.860892, 'last_price_update_time': 1769626888.551747}
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118923512') HTTP/1.1" 204 0
2026-01-28 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e67ca1ac-ccec-52da-8090-837ecc97430b with identifier: 118432035
2026-01-28 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e67ca1ac-ccec-52da-8090-837ecc97430b with identifier: 118432035
2026-01-28 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e67ca1ac-ccec-52da-8090-837ecc97430b with identifier: 118432035 to the API
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118432035?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': 'e67ca1ac-ccec-52da-8090-837ecc97430b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX69CAV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118432035',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'KIA',
'model': 'CEED SPORTSWAGON',
'odometer': 77380,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-12',
'seller_name': 'Part of United Rental Group',
'title': 'KIA CEED SPORTSWAGON 1.0T GDi ISG 2 NAV 5dr',
'transmission': 'manual',
'trim': '1.0T GDi ISG 2 NAV 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118432035%27 HTTP/1.1" 200 None
2026-01-28 19:01:28 [astonbarclay.gb] INFO: Saving data for 118432035: {'auction_closing_time': 1769774400.0, 'created_time': 1767987430.912649, 'last_price_update_time': 1769626888.880226}
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118432035') HTTP/1.1" 204 0
2026-01-28 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with identifier: 118741643
2026-01-28 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with identifier: 118741643
2026-01-28 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e8f107fc-3544-522e-ab1c-25f2e9c2a7e6 with identifier: 118741643 to the API
2026-01-28 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e8f107fc-3544-522e-ab1c-25f2e9c2a7e6%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e8f107fc-3544-522e-ab1c-25f2e9c2a7e6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118741643?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Petrol',
'id': 'e8f107fc-3544-522e-ab1c-25f2e9c2a7e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VN67TBO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118741643',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'SMART',
'model': 'FORTWO COUPE',
'odometer': 51318,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-04',
'seller_name': 'Advance Vehicle Leasing',
'title': 'SMART FORTWO COUPE 1.0 Passion Premium 2dr Auto',
'transmission': 'automatic',
'trim': '1.0 Passion Premium 2dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118741643%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Saving data for 118741643: {'auction_closing_time': 1770123600.0, 'created_time': 1768936341.063073, 'last_price_update_time': 1769626889.171343}
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118741643') HTTP/1.1" 204 0
2026-01-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118137730?view=catalogue)
2026-01-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118331157?view=catalogue)
2026-01-28 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 118984331
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118984331%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Scrape type for 118984331: 0
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 118986387
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118986387%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Scrape type for 118986387: 0
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 119054391
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054391%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Scrape type for 119054391: 1
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190314490>
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Fe14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190496bd0>
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 119045926
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045926%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [astonbarclay.gb] INFO: Scrape type for 119045926: 1
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b8810>
2026-01-28 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319053b410>
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063131?view=catalogue)
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 118918627
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918627%27 HTTP/1.1" 200 None
2026-01-28 19:01:30 [astonbarclay.gb] INFO: Scrape type for 118918627: 0
2026-01-28 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 119030851
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030851%27 HTTP/1.1" 200 None
2026-01-28 19:01:30 [astonbarclay.gb] INFO: Scrape type for 119030851: 1
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Ffe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118950190?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191977110>
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN196A%252F2025-12-19%252Fimage%252Ffd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7
2026-01-28 19:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7, skipping ID generation
2026-01-28 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 with scrape type 1
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 from tracking dictionaries
2026-01-28 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 sending to next pipeline
2026-01-28 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7, identifier: 118137730
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904ff110>
2026-01-28 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRMN207A%252F2026-01-06%252Fimage%252F7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61784c54-d8c3-5601-b33d-ba84d750aefa
2026-01-28 19:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61784c54-d8c3-5601-b33d-ba84d750aefa, skipping ID generation
2026-01-28 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61784c54-d8c3-5601-b33d-ba84d750aefa with scrape type 1
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 61784c54-d8c3-5601-b33d-ba84d750aefa from tracking dictionaries
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61784c54-d8c3-5601-b33d-ba84d750aefa sending to next pipeline
2026-01-28 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61784c54-d8c3-5601-b33d-ba84d750aefa, identifier: 118331157
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190256ad0>
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252F8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 with identifier: 118137730
2026-01-28 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 with identifier: 118137730
2026-01-28 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 spider: astonbarclay.gb
2026-01-28 19:01:31 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bc45cea6-e6fb-5d03-b3d1-bf6544a311e7 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': None,
'color': None,
'currency': 'GBP',
'doors_number': 5,
'emission_standard': None,
'engine': '',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': 'bc45cea6-e6fb-5d03-b3d1-bf6544a311e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RMN196A',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118137730',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'HYUNDAI',
'model': 'TUCSON ESTATE',
'odometer': 22671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37961,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/9d26cbc5-6199-4afe-bb66-92b65bc473c1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39343,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/fd8836c4-03aa-4301-ba36-f88e3a541f2f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36959,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/c8905f4d-5683-415d-ae9f-c8853f2cbf97_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38555,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/17040c84-8ded-4169-a21a-7e6566033b71_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44809,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/df36e7ed-d503-48ce-b58e-d7a4ae470b6e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56682,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/5ae26506-92ba-4d73-bc2b-33952bd5727e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52940,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/e14ac9bf-e96d-408b-b753-563eca8b4913_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51433,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/49e01b1a-ea42-4fc0-ace9-39e3ba25c0b2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50793,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/1f63c025-89dc-46fa-b54e-20945769081e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45cea6-e6fb-5d03-b3d1-bf6544a311e7/bc45cea6-e6fb-5d03-b3d1-bf6544a311e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49792,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN196A/2025-12-19/image/cf77e8ec-c447-4161-8055-6c83668696d2_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-24',
'seller_name': 'Motability Operations',
'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi 48V MHD Premium 5dr 2WD DCT',
'transmission': 'automatic',
'trim': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT',
'vin': None,
'year': 2022}
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137730%27 HTTP/1.1" 200 None
2026-01-28 19:01:31 [astonbarclay.gb] INFO: Saving data for 118137730: {'created_time': 1769626891.991341, 'last_price_update_time': 1769626891.991352, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118137730') HTTP/1.1" 204 0
2026-01-28 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61784c54-d8c3-5601-b33d-ba84d750aefa with identifier: 118331157
2026-01-28 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61784c54-d8c3-5601-b33d-ba84d750aefa with identifier: 118331157
2026-01-28 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 61784c54-d8c3-5601-b33d-ba84d750aefa spider: astonbarclay.gb
2026-01-28 19:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 61784c54-d8c3-5601-b33d-ba84d750aefa due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': None,
'color': None,
'currency': 'GBP',
'doors_number': 5,
'emission_standard': None,
'engine': '',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '61784c54-d8c3-5601-b33d-ba84d750aefa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RMN207A',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118331157',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'HYUNDAI',
'model': 'KONA HATCHBACK',
'odometer': 11654,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34345,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/9d0aa3c0-9cae-41ad-866f-9301717c64e8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35596,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/7b2054a1-c2fa-4974-8a76-0cf0463f638c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41025,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/158594b3-5127-4a74-a256-6f835724120e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41063,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/08c930c0-0eba-4253-9475-c5fff74668c1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55222,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/3331b0df-b931-45a0-8635-4b11a45813c2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65605,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/57bd898b-df64-40f6-b7df-d3dd9b5952bc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72147,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/2c5c29e5-8545-43bb-a8f9-c08f7f14afde_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52710,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/37650bc8-7887-4c6a-a2d3-0f8ed2616b54_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61784c54-d8c3-5601-b33d-ba84d750aefa/61784c54-d8c3-5601-b33d-ba84d750aefa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49527,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RMN207A/2026-01-06/image/63fa6977-d8cc-45f4-bdad-6f19278db477_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-04',
'seller_name': 'Motability Operations',
'title': 'HYUNDAI KONA HATCHBACK 1.6 GDi Hybrid Premium 5dr DCT',
'transmission': 'automatic',
'trim': '1.6 GDi Hybrid Premium 5dr DCT',
'vin': None,
'year': 2022}
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118331157%27 HTTP/1.1" 200 None
2026-01-28 19:01:32 [astonbarclay.gb] INFO: Saving data for 118331157: {'created_time': 1769626892.203561, 'last_price_update_time': 1769626892.20357, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118331157') HTTP/1.1" 204 0
2026-01-28 19:01:32 [astonbarclay.gb] INFO: Found listing with ID: 119030424
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030424%27 HTTP/1.1" 200 None
2026-01-28 19:01:32 [astonbarclay.gb] INFO: Scrape type for 119030424: 1
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118723618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118723655?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118950178?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190524ed0>
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fe654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190163210>
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC72FKG%252F2026-01-28%252Fimage%252Fb4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca
2026-01-28 19:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12fe7b42-fff0-574d-bbdd-7696e1d40eca, skipping ID generation
2026-01-28 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca with scrape type 1
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12fe7b42-fff0-574d-bbdd-7696e1d40eca from tracking dictionaries
2026-01-28 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12fe7b42-fff0-574d-bbdd-7696e1d40eca sending to next pipeline
2026-01-28 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 12fe7b42-fff0-574d-bbdd-7696e1d40eca, identifier: 119063131
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903e1690>
2026-01-28 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319049e3d0>
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Fd0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190471a10>
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118994797, 'registration': 'BC68XXJ', 'account': 'MER023', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr 2WD', 'mileage': 63150, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - Partial leather Dinamica Charcoal Black, Privacy glass on the rear window and on the rear side windows, Heated washers, Electrically heated windscreen', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4438abe6-ac9b-47bb-80c1-996fa569ca35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118994797, 'registration': 'BC68XXJ', 'account': 'MER023', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr 2WD', 'mileage': 63150, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - Partial leather Dinamica Charcoal Black, Privacy glass on the rear window and on the rear side windows, Heated washers, Electrically heated windscreen', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4438abe6-ac9b-47bb-80c1-996fa569ca35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520b2600-3466-5305-b319-5530aab7b91b with identifier: 118994797
2026-01-28 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520b2600-3466-5305-b319-5530aab7b91b with scrape type 1
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119054500, 'registration': 'LL21UHT', 'account': 'MER023', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.0T GDi ISG 2 5dr', 'mileage': 22622, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-06-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2/24 15K, 2/25 18K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bdd9598c-304f-4b7d-b1e0-926f892b34ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119054500, 'registration': 'LL21UHT', 'account': 'MER023', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.0T GDi ISG 2 5dr', 'mileage': 22622, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-06-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2/24 15K, 2/25 18K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bdd9598c-304f-4b7d-b1e0-926f892b34ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with identifier: 119054500
2026-01-28 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with scrape type 1
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118950190, 'registration': 'WP66EWC', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 DiG-T Tekna 5dr 4WD Xtronic', 'mileage': 54393, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-12-06', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/020bc5cb-47d0-46bc-86e2-99bc298007a1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118950190, 'registration': 'WP66EWC', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 DiG-T Tekna 5dr 4WD Xtronic', 'mileage': 54393, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-12-06', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/020bc5cb-47d0-46bc-86e2-99bc298007a1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b4cedfd-0162-51d4-a7d8-5c025f502c86 with identifier: 118950190
2026-01-28 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b4cedfd-0162-51d4-a7d8-5c025f502c86 with scrape type 1
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1b4cedfd-0162-51d4-a7d8-5c025f502c86
2026-01-28 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1b4cedfd-0162-51d4-a7d8-5c025f502c86
2026-01-28 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1b4cedfd-0162-51d4-a7d8-5c025f502c86, identifier: 118950190
2026-01-28 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 119027974
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119027974%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Scrape type for 119027974: 1
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 12fe7b42-fff0-574d-bbdd-7696e1d40eca with identifier: 119063131
2026-01-28 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 12fe7b42-fff0-574d-bbdd-7696e1d40eca with identifier: 119063131
2026-01-28 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 12fe7b42-fff0-574d-bbdd-7696e1d40eca with identifier: 119063131 to the API
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '12fe7b42-fff0-574d-bbdd-7696e1d40eca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YC72FKG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119063131',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'VAUXHALL',
'model': 'GRANDLAND HATCHBACK',
'odometer': 6214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35610,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/e654dbee-d342-4cdd-a714-42e474dbff63_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35504,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b4ea18ff-b85e-44ae-ba37-bf81c07df137_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34944,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/1efcc7d5-8573-4d84-a742-5fc725c49788_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35424,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/26552724-c7ef-43fd-a688-a04a69f19905_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47209,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/8c1992e4-58be-44fa-9068-662fce56243a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54839,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/ea3b2716-1cfe-4d6d-829e-c355c56a76d2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55009,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/68ef44b5-1307-4066-8e97-1c7d5d36dba5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45260,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/3d1edf87-d277-407c-87a5-cbd8eb67c1a0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54225,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/7552f8a0-88cb-4617-8c9d-7218811b1639_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44831,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/80be5f24-3b25-491e-9742-ae3292268af7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59659,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/67c7cb53-2a13-47b1-ab20-a8ae3cb06ec4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43537,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/c3753115-d04d-470c-88fa-72b6b5b7af96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23970,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a14723-dc22-4be7-aa92-f35da51b63b7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12fe7b42-fff0-574d-bbdd-7696e1d40eca/12fe7b42-fff0-574d-bbdd-7696e1d40eca_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43908,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YC72FKG/2026-01-28/image/b3a8d3e6-86df-474c-91e5-e03d9717ec85_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seller_name': 'Motability Operations',
'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Ultimate 5dr',
'transmission': 'manual',
'trim': '1.2 Turbo Ultimate 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119063131%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Saving data for 119063131: {'created_time': 1769626894.449144, 'last_price_update_time': 1769626894.449154, 'auction_closing_time': 1770114600.0}
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119063131') HTTP/1.1" 204 0
2026-01-28 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1b4cedfd-0162-51d4-a7d8-5c025f502c86 with identifier: 118950190
2026-01-28 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1b4cedfd-0162-51d4-a7d8-5c025f502c86 with identifier: 118950190
2026-01-28 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 1b4cedfd-0162-51d4-a7d8-5c025f502c86 spider: astonbarclay.gb
2026-01-28 19:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1b4cedfd-0162-51d4-a7d8-5c025f502c86 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '1b4cedfd-0162-51d4-a7d8-5c025f502c86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WP66EWC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118950190',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 54393,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seller_name': 'Wilsons',
'title': 'NISSAN JUKE HATCHBACK 1.6 DiG-T Tekna 5dr 4WD Xtronic',
'transmission': 'automatic',
'trim': '1.6 DiG-T Tekna 5dr 4WD Xtronic',
'vin': None,
'year': 2016}
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950190%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Saving data for 118950190: {'created_time': 1769626894.668776, 'last_price_update_time': 1769626894.668789, 'auction_closing_time': 1770198300.0}
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118950190') HTTP/1.1" 204 0
2026-01-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019822?view=catalogue)
2026-01-28 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Fd159e375-208b-45ef-a305-8027530cd01a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 118995553
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118995553%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Scrape type for 118995553: 0
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 119034643
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034643%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [astonbarclay.gb] INFO: Scrape type for 119034643: 1
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252Fb939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Fd1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190119c10>
2026-01-28 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900b1390>
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118723618, 'registration': 'DX19XCN', 'account': 'GAP001', 'make': 'DAF TRUCKS', 'model': 'LF', 'derivative': None, 'mileage': 190409, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': None, 'firstRegistration': '2019-05-16', 'fuel': 'Diesel', 'motExpiry': None, 'doors': None, 'engineSize': 4500, 'bodyType': 'Curtain-Sided', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118723618, 'registration': 'DX19XCN', 'account': 'GAP001', 'make': 'DAF TRUCKS', 'model': 'LF', 'derivative': None, 'mileage': 190409, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': None, 'firstRegistration': '2019-05-16', 'fuel': 'Diesel', 'motExpiry': None, 'doors': None, 'engineSize': 4500, 'bodyType': 'Curtain-Sided', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:35 [astonbarclay.gb] ERROR: Error parsing details: Field transmission is not nullable
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118723655, 'registration': 'DX19XCY', 'account': 'GAP001', 'make': 'DAF TRUCKS', 'model': 'LF', 'derivative': None, 'mileage': 160548, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': None, 'firstRegistration': '2019-05-10', 'fuel': 'Diesel', 'motExpiry': None, 'doors': None, 'engineSize': 4500, 'bodyType': 'Curtain-Sided', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118723655, 'registration': 'DX19XCY', 'account': 'GAP001', 'make': 'DAF TRUCKS', 'model': 'LF', 'derivative': None, 'mileage': 160548, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': None, 'firstRegistration': '2019-05-10', 'fuel': 'Diesel', 'motExpiry': None, 'doors': None, 'engineSize': 4500, 'bodyType': 'Curtain-Sided', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2026-01-28 19:01:35 [astonbarclay.gb] ERROR: Error parsing details: Field transmission is not nullable
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118950178, 'registration': 'LD19YRJ', 'account': 'WIL004', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 130 Prestige 5dr', 'mileage': 58195, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1eb710f3-7f3c-4c98-a690-d7d9db938840.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118950178, 'registration': 'LD19YRJ', 'account': 'WIL004', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 130 Prestige 5dr', 'mileage': 58195, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1eb710f3-7f3c-4c98-a690-d7d9db938840.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2032cfcd-fd35-58e9-8dac-3516ef035126 with identifier: 118950178
2026-01-28 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2032cfcd-fd35-58e9-8dac-3516ef035126 with scrape type 1
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2032cfcd-fd35-58e9-8dac-3516ef035126
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2032cfcd-fd35-58e9-8dac-3516ef035126
2026-01-28 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2032cfcd-fd35-58e9-8dac-3516ef035126, identifier: 118950178
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119054522, 'registration': 'HV66AWW', 'account': 'MER023', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d xLine 5dr Step Auto', 'mileage': 82491, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book iDRIVE @ 01/18-16k, 12/18-31k, 05/19-35k - BOOK @ 05/22 48K, 08/23 57K, 05/24 64K -', 'remarks': 'S/KEY - Loudspeaker system - BMW Advanced, Sun protection glazing, Exterior mirrors - electrically folding with anti-dazzle, High-beam assistant, Xenon Headlights, Navigation System - BMW Professional Multimedia, Nevada leather, Oyster', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35330f1d-9793-4465-a64e-f3e6edc9681a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119054522, 'registration': 'HV66AWW', 'account': 'MER023', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d xLine 5dr Step Auto', 'mileage': 82491, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book iDRIVE @ 01/18-16k, 12/18-31k, 05/19-35k - BOOK @ 05/22 48K, 08/23 57K, 05/24 64K -', 'remarks': 'S/KEY - Loudspeaker system - BMW Advanced, Sun protection glazing, Exterior mirrors - electrically folding with anti-dazzle, High-beam assistant, Xenon Headlights, Navigation System - BMW Professional Multimedia, Nevada leather, Oyster', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35330f1d-9793-4465-a64e-f3e6edc9681a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 with identifier: 119054522
2026-01-28 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 with scrape type 1
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fd60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2032cfcd-fd35-58e9-8dac-3516ef035126 with identifier: 118950178
2026-01-28 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2032cfcd-fd35-58e9-8dac-3516ef035126 with identifier: 118950178
2026-01-28 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2032cfcd-fd35-58e9-8dac-3516ef035126 with identifier: 118950178 to the API
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272032cfcd-fd35-58e9-8dac-3516ef035126%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2032cfcd-fd35-58e9-8dac-3516ef035126: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118950178?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '2032cfcd-fd35-58e9-8dac-3516ef035126',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LD19YRJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118950178',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'DACIA',
'model': 'DUSTER ESTATE',
'odometer': 58195,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': 'Wilsons',
'title': 'DACIA DUSTER ESTATE 1.3 TCe 130 Prestige 5dr',
'transmission': 'manual',
'trim': '1.3 TCe 130 Prestige 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118950178%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Saving data for 118950178: {'created_time': 1769626895.891069, 'last_price_update_time': 1769626895.891079, 'auction_closing_time': 1770198300.0}
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118950178') HTTP/1.1" 204 0
2026-01-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 118870431
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118870431%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Scrape type for 118870431: 0
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 119021364
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119021364%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [astonbarclay.gb] INFO: Scrape type for 119021364: 1
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252Fc6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190391750>
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118994826, 'registration': 'HV69HCD', 'account': 'MER023', 'make': 'SEAT', 'model': 'TARRACO ESTATE', 'derivative': '1.5 EcoTSI SE Technology 5dr', 'mileage': 85593, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-17', 'fuel': 'Petrol', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 21/1 9K, 1/22 22K, 12/22 36K, 12/23 48K, 7/24 57K, 1/25 66K, 9/25 79K,', 'remarks': 'S/KEY, SD Card', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e0b7c58-a4ac-40ad-af46-ebe2a9316020.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118994826, 'registration': 'HV69HCD', 'account': 'MER023', 'make': 'SEAT', 'model': 'TARRACO ESTATE', 'derivative': '1.5 EcoTSI SE Technology 5dr', 'mileage': 85593, 'mileageWarranty': True, 'type': 'car', 'saleId': 18598, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 64}, 'saleStart': '2026-02-04T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-17', 'fuel': 'Petrol', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 21/1 9K, 1/22 22K, 12/22 36K, 12/23 48K, 7/24 57K, 1/25 66K, 9/25 79K,', 'remarks': 'S/KEY, SD Card', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e0b7c58-a4ac-40ad-af46-ebe2a9316020.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with identifier: 118994826
2026-01-28 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with scrape type 1
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ff370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 119035154
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035154%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [astonbarclay.gb] INFO: Scrape type for 119035154: 1
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Ff96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190096c10>
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903ed090>
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE66VCP%252F2026-01-28%252Fimage%252Faee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87ac3c33-866c-5b44-8409-bf0bc5811e62
2026-01-28 19:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87ac3c33-866c-5b44-8409-bf0bc5811e62, skipping ID generation
2026-01-28 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ac3c33-866c-5b44-8409-bf0bc5811e62 with scrape type 1
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 87ac3c33-866c-5b44-8409-bf0bc5811e62 from tracking dictionaries
2026-01-28 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87ac3c33-866c-5b44-8409-bf0bc5811e62 sending to next pipeline
2026-01-28 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87ac3c33-866c-5b44-8409-bf0bc5811e62, identifier: 119019822
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Fcac27466-621f-4100-bbbe-996725982442_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87ac3c33-866c-5b44-8409-bf0bc5811e62 with identifier: 119019822
2026-01-28 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87ac3c33-866c-5b44-8409-bf0bc5811e62 with identifier: 119019822
2026-01-28 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167192 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167192
2026-01-28 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 87ac3c33-866c-5b44-8409-bf0bc5811e62 spider: astonbarclay.gb
2026-01-28 19:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 87ac3c33-866c-5b44-8409-bf0bc5811e62 due to rule: high_mileage_for_country.json, error: 167192 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167192
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Diesel',
'id': '87ac3c33-866c-5b44-8409-bf0bc5811e62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VE66VCP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119019822',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'X-TRAIL DIESEL STATION WAGON',
'odometer': 103889,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32214,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fe6a889d-f431-4e40-9d6a-ac319d5c233e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40548,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/aee82347-82f1-4d3f-a748-68ab7101e092_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31485,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/733552d9-9a1f-45c3-ba07-4575732c3e04_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34476,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/fa0682b3-c194-4aa2-b213-bfdea6ef20f7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50240,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/648812f5-3f10-4cf3-a272-bc952be4a749_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57534,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/293874e8-1154-42a8-baf8-df636d776868_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42898,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/1f2818ca-87a3-44bf-beb7-c4f5cf566aad_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33249,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/276346c2-ce59-4e31-abad-4ab78ca21150_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ac3c33-866c-5b44-8409-bf0bc5811e62/87ac3c33-866c-5b44-8409-bf0bc5811e62_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46378,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VE66VCP/2026-01-28/image/84ca2c3b-5362-4713-b926-54850a30b0f2_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-01',
'seller_name': 'UKCGR - Select',
'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi Acenta 5dr [7 Seat]',
'transmission': 'manual',
'trim': '1.6 dCi Acenta 5dr [7 Seat]',
'vin': None,
'year': 2016}
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119019822%27 HTTP/1.1" 200 None
2026-01-28 19:01:37 [astonbarclay.gb] INFO: Saving data for 119019822: {'created_time': 1769626897.26236, 'last_price_update_time': 1769626897.26237, 'auction_closing_time': 1770053400.0}
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119019822') HTTP/1.1" 204 0
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901ba790>
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916441d0>
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Ffe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a9ed0>
2026-01-28 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902e8950>
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 119029093
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119029093%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [astonbarclay.gb] INFO: Scrape type for 119029093: 1
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118923360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119053712?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190619110>
2026-01-28 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190218c90>
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3192f1b110>
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 119026534
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119026534%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Scrape type for 119026534: 1
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fcb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ffad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119029737, 'registration': 'EF23VVR', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA TITANIUM X TURBO M', 'derivative': None, 'mileage': 21559, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-06-17', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/498c3391-b233-4fa3-886d-92b0b21312fa.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119029737, 'registration': 'EF23VVR', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA TITANIUM X TURBO M', 'derivative': None, 'mileage': 21559, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-06-17', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/498c3391-b233-4fa3-886d-92b0b21312fa.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with identifier: 119029737
2026-01-28 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with scrape type 1
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 119053970
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053970%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [astonbarclay.gb] INFO: Scrape type for 119053970: 1
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fb7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190108510>
2026-01-28 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fd60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3193014bd0>
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Fd1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118923360, 'registration': 'BD70JXV', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DEFENDER DIESEL ESTATE', 'derivative': '2.0 D240 SE 110 5dr Auto', 'mileage': 63316, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-10-09', 'fuel': 'Diesel', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 41K, 50K, 61K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 240, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118923360, 'registration': 'BD70JXV', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DEFENDER DIESEL ESTATE', 'derivative': '2.0 D240 SE 110 5dr Auto', 'mileage': 63316, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-10-09', 'fuel': 'Diesel', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 41K, 50K, 61K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 240, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f5f570-7161-54c9-9a65-2c23e801aa93 with identifier: 118923360
2026-01-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f5f570-7161-54c9-9a65-2c23e801aa93 with scrape type 2
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f5f570-7161-54c9-9a65-2c23e801aa93 with scrape type 2
2026-01-28 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d2f5f570-7161-54c9-9a65-2c23e801aa93, identifier: 118923360
2026-01-28 19:01:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119053712, 'registration': 'EA72BHL', 'account': 'WBA002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Sport 5dr', 'mileage': 33958, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/850189d3-c538-4521-805a-2718307c4931.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119053712, 'registration': 'EA72BHL', 'account': 'WBA002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Sport 5dr', 'mileage': 33958, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/850189d3-c538-4521-805a-2718307c4931.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b7b121-b47f-5bf9-8b03-8a40ca18c42f with identifier: 119053712
2026-01-28 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b7b121-b47f-5bf9-8b03-8a40ca18c42f with scrape type 1
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 02b7b121-b47f-5bf9-8b03-8a40ca18c42f
2026-01-28 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 02b7b121-b47f-5bf9-8b03-8a40ca18c42f
2026-01-28 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 02b7b121-b47f-5bf9-8b03-8a40ca18c42f, identifier: 119053712
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028c7d0>
2026-01-28 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190287d10>
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Fd159e375-208b-45ef-a305-8027530cd01a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902e0a10>
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b9f10>
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252Fb939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fd5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d2f5f570-7161-54c9-9a65-2c23e801aa93 with identifier: 118923360
2026-01-28 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d2f5f570-7161-54c9-9a65-2c23e801aa93 with identifier: 118923360
2026-01-28 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d2f5f570-7161-54c9-9a65-2c23e801aa93 with identifier: 118923360 to the API
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d2f5f570-7161-54c9-9a65-2c23e801aa93%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d2f5f570-7161-54c9-9a65-2c23e801aa93: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118923360?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 240,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': 'd2f5f570-7161-54c9-9a65-2c23e801aa93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BD70JXV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118923360',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'DEFENDER DIESEL ESTATE',
'odometer': 63316,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-09',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER DEFENDER DIESEL ESTATE 2.0 D240 SE 110 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 D240 SE 110 5dr Auto',
'vin': None,
'year': 2020}
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118923360%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Saving data for 118923360: {'auction_closing_time': 1770123600.0, 'created_time': 1769158977.645169, 'last_price_update_time': 1769626902.287326}
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118923360') HTTP/1.1" 204 0
2026-01-28 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 02b7b121-b47f-5bf9-8b03-8a40ca18c42f with identifier: 119053712
2026-01-28 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 02b7b121-b47f-5bf9-8b03-8a40ca18c42f with identifier: 119053712
2026-01-28 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 02b7b121-b47f-5bf9-8b03-8a40ca18c42f with identifier: 119053712 to the API
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2702b7b121-b47f-5bf9-8b03-8a40ca18c42f%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 02b7b121-b47f-5bf9-8b03-8a40ca18c42f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119053712?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02b7b121-b47f-5bf9-8b03-8a40ca18c42f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EA72BHL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053712',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'AUDI',
'model': 'Q2 ESTATE',
'odometer': 33958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-29',
'seller_name': 'UKCGR - Premium',
'title': 'AUDI Q2 ESTATE 30 TFSI Sport 5dr',
'transmission': 'manual',
'trim': '30 TFSI Sport 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053712%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Saving data for 119053712: {'created_time': 1769626902.580936, 'last_price_update_time': 1769626902.58095, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119053712') HTTP/1.1" 204 0
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 119034053
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034053%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Scrape type for 119034053: 1
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fb875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119054391?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ff889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 119019376
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119019376%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [astonbarclay.gb] INFO: Scrape type for 119019376: 1
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fe67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319063f150>
2026-01-28 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b8590>
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252Ff96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903f0950>
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a9410>
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ff370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190101f10>
2026-01-28 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319063b050>
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900e78d0>
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319029ac90>
2026-01-28 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Fcac27466-621f-4100-bbbe-996725982442_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 119034549
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034549%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Scrape type for 119034549: 1
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fdc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119030424?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119045926?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948685?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fb6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119054391, 'registration': 'LA17RHK', 'account': 'WBA002', 'make': 'BMW', 'model': '4 SERIES COUPE', 'derivative': '420i M Sport 2dr Auto [Professional Media]', 'mileage': 77335, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-17', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/57284634-1a0d-467d-a550-354218f2e06f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119054391, 'registration': 'LA17RHK', 'account': 'WBA002', 'make': 'BMW', 'model': '4 SERIES COUPE', 'derivative': '420i M Sport 2dr Auto [Professional Media]', 'mileage': 77335, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-17', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/57284634-1a0d-467d-a550-354218f2e06f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a9ae9a-177c-544f-998e-d97ebce1245d with identifier: 119054391
2026-01-28 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a9ae9a-177c-544f-998e-d97ebce1245d with scrape type 1
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 73a9ae9a-177c-544f-998e-d97ebce1245d
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 73a9ae9a-177c-544f-998e-d97ebce1245d
2026-01-28 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 73a9ae9a-177c-544f-998e-d97ebce1245d, identifier: 119054391
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 119032831
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119032831%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Scrape type for 119032831: 1
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fdf4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fa26c690a-b71a-4506-be73-80327b095a75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 73a9ae9a-177c-544f-998e-d97ebce1245d with identifier: 119054391
2026-01-28 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 73a9ae9a-177c-544f-998e-d97ebce1245d with identifier: 119054391
2026-01-28 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 73a9ae9a-177c-544f-998e-d97ebce1245d with identifier: 119054391 to the API
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2773a9ae9a-177c-544f-998e-d97ebce1245d%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 73a9ae9a-177c-544f-998e-d97ebce1245d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119054391?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '73a9ae9a-177c-544f-998e-d97ebce1245d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LA17RHK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119054391',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'BMW',
'model': '4 SERIES COUPE',
'odometer': 77335,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seller_name': 'UKCGR - Premium',
'title': 'BMW 4 SERIES COUPE 420i M Sport 2dr Auto [Professional Media]',
'transmission': 'automatic',
'trim': '420i M Sport 2dr Auto [Professional Media]',
'vin': None,
'year': 2017}
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054391%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Saving data for 119054391: {'created_time': 1769626905.696293, 'last_price_update_time': 1769626905.696303, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119054391') HTTP/1.1" 204 0
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 119022350
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022350%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [astonbarclay.gb] INFO: Scrape type for 119022350: 1
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191664ed0>
2026-01-28 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e0350>
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fcb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319018d910>
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e3210>
2026-01-28 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ffad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e3990>
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e8a90>
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119030424, 'registration': 'VE18RXN', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 190 4Motion SEL 5dr DSG', 'mileage': 55074, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-26', 'fuel': 'Diesel', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f0c8a9b-6e08-4e39-a3b1-602d1f6bbb0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119030424, 'registration': 'VE18RXN', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 190 4Motion SEL 5dr DSG', 'mileage': 55074, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-26', 'fuel': 'Diesel', 'motExpiry': '2026-12-22', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f0c8a9b-6e08-4e39-a3b1-602d1f6bbb0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120f4e43-73f3-5f65-82e3-bf57f04dccbc with identifier: 119030424
2026-01-28 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120f4e43-73f3-5f65-82e3-bf57f04dccbc with scrape type 1
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 120f4e43-73f3-5f65-82e3-bf57f04dccbc
2026-01-28 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 120f4e43-73f3-5f65-82e3-bf57f04dccbc
2026-01-28 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 120f4e43-73f3-5f65-82e3-bf57f04dccbc, identifier: 119030424
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119045926, 'registration': 'YJ69OBF', 'account': 'WBA002', 'make': 'MAZDA', 'model': 'MAZDA3 SALOON', 'derivative': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr Auto', 'mileage': 31921, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-15', 'fuel': 'Petrol', 'motExpiry': '2026-10-22', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a25d27a0-d1aa-4a78-9672-f5863388d6aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119045926, 'registration': 'YJ69OBF', 'account': 'WBA002', 'make': 'MAZDA', 'model': 'MAZDA3 SALOON', 'derivative': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr Auto', 'mileage': 31921, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-15', 'fuel': 'Petrol', 'motExpiry': '2026-10-22', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a25d27a0-d1aa-4a78-9672-f5863388d6aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5f0383-ea70-5021-852c-0acb413e40ad with identifier: 119045926
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5f0383-ea70-5021-852c-0acb413e40ad with scrape type 1
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fd5f0383-ea70-5021-852c-0acb413e40ad
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fd5f0383-ea70-5021-852c-0acb413e40ad
2026-01-28 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fd5f0383-ea70-5021-852c-0acb413e40ad, identifier: 119045926
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119051634, 'registration': 'LD67EYM', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Play 5dr', 'mileage': 33806, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/19- 12K, 05/21- 24K, 04/22- 26K, 04/23- 28K, 05/24- 31K', 'remarks': '**629**VOSA STATES 24K, 26K, 28K, 31K, 33K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/750a8a2c-0716-43a8-a1fe-0a372302b7ca.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119051634, 'registration': 'LD67EYM', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Play 5dr', 'mileage': 33806, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/19- 12K, 05/21- 24K, 04/22- 26K, 04/23- 28K, 05/24- 31K', 'remarks': '**629**VOSA STATES 24K, 26K, 28K, 31K, 33K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/750a8a2c-0716-43a8-a1fe-0a372302b7ca.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5078cd33-e5ee-5589-9316-e7d686f2c341 with identifier: 119051634
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5078cd33-e5ee-5589-9316-e7d686f2c341 with scrape type 1
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948685, 'registration': 'LO71RFZ', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '50 TDI Quattro S Line 5dr Tiptronic', 'mileage': 31969, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-15', 'fuel': 'Diesel', 'motExpiry': '2027-01-14', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/63093a36-737c-48d4-b9a2-de02a1f764c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/82ab1c4c-53d2-4404-ae65-0072383e2244_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/48e30dcd-5268-4aee-92d4-e024faa19289_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/2d765b8b-abe4-4cac-8aa6-ca5a8b84f7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/4c3947ea-2b3a-4fc5-b02d-eb63a06a9b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/29892800-1bb0-4b8b-8fe6-86e7272e0dfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/1b679ab4-7cff-4829-9ed7-ba89068f68e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/71506cef-b611-4fb7-b4d6-1bfea1b9e627_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/eba6f77d-0068-4e58-9731-b0f905b897e1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**23**VOSA STATES 23K, 31K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 210, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a18954e-4db1-417c-a278-f85e1583c168.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948685, 'registration': 'LO71RFZ', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '50 TDI Quattro S Line 5dr Tiptronic', 'mileage': 31969, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-15', 'fuel': 'Diesel', 'motExpiry': '2027-01-14', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/63093a36-737c-48d4-b9a2-de02a1f764c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/82ab1c4c-53d2-4404-ae65-0072383e2244_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/48e30dcd-5268-4aee-92d4-e024faa19289_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/2d765b8b-abe4-4cac-8aa6-ca5a8b84f7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/4c3947ea-2b3a-4fc5-b02d-eb63a06a9b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/29892800-1bb0-4b8b-8fe6-86e7272e0dfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/1b679ab4-7cff-4829-9ed7-ba89068f68e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/71506cef-b611-4fb7-b4d6-1bfea1b9e627_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71RFZ/2026-01-28/image/eba6f77d-0068-4e58-9731-b0f905b897e1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**23**VOSA STATES 23K, 31K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 210, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a18954e-4db1-417c-a278-f85e1583c168.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ca1182-222c-588f-abbc-8ce3a5e7196e with identifier: 118948685
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ca1182-222c-588f-abbc-8ce3a5e7196e with scrape type 2
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61ca1182-222c-588f-abbc-8ce3a5e7196e with scrape type 2
2026-01-28 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61ca1182-222c-588f-abbc-8ce3a5e7196e, identifier: 118948685
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119030851, 'registration': 'WD71ZBF', 'account': 'WBA002', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.6 CRDi 48V ISG GT-Line S 5dr DCT Auto [AWD]', 'mileage': 28731, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/119361f9-3305-4baf-9731-7312291da971.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119030851, 'registration': 'WD71ZBF', 'account': 'WBA002', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.6 CRDi 48V ISG GT-Line S 5dr DCT Auto [AWD]', 'mileage': 28731, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/119361f9-3305-4baf-9731-7312291da971.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f02385-4490-54b1-b24e-f22fee829845 with identifier: 119030851
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f02385-4490-54b1-b24e-f22fee829845 with scrape type 1
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119034643, 'registration': 'KW21HYL', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d [2.0] AMG Line Premium Plus 5dr Auto', 'mileage': 36949, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-04-15', 'fuel': 'Diesel', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b12a1201-e830-417e-a42c-f19795fb9487.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119034643, 'registration': 'KW21HYL', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d [2.0] AMG Line Premium Plus 5dr Auto', 'mileage': 36949, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-04-15', 'fuel': 'Diesel', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b12a1201-e830-417e-a42c-f19795fb9487.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd15f53-45f8-587c-9d32-17c545e0afff with identifier: 119034643
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd15f53-45f8-587c-9d32-17c545e0afff with scrape type 1
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119035154, 'registration': 'LR67YDN', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 SRi 5dr', 'mileage': 48630, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13407b79-1f0a-4c06-828a-0e2c0bcd4e6c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119035154, 'registration': 'LR67YDN', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 SRi 5dr', 'mileage': 48630, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13407b79-1f0a-4c06-828a-0e2c0bcd4e6c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 629a1267-5e43-5f14-945b-ea775c726337 with identifier: 119035154
2026-01-28 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 629a1267-5e43-5f14-945b-ea775c726337 with scrape type 1
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318360f050>
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 120f4e43-73f3-5f65-82e3-bf57f04dccbc with identifier: 119030424
2026-01-28 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 120f4e43-73f3-5f65-82e3-bf57f04dccbc with identifier: 119030424
2026-01-28 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 120f4e43-73f3-5f65-82e3-bf57f04dccbc with identifier: 119030424 to the API
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27120f4e43-73f3-5f65-82e3-bf57f04dccbc%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 120f4e43-73f3-5f65-82e3-bf57f04dccbc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119030424?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '120f4e43-73f3-5f65-82e3-bf57f04dccbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VE18RXN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119030424',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN DIESEL ESTATE',
'odometer': 55074,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seller_name': 'UKCGR - Premium',
'title': 'VOLKSWAGEN TIGUAN DIESEL ESTATE 2.0 TDi 190 4Motion SEL 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TDi 190 4Motion SEL 5dr DSG',
'vin': None,
'year': 2018}
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030424%27 HTTP/1.1" 200 None
2026-01-28 19:01:48 [astonbarclay.gb] INFO: Saving data for 119030424: {'created_time': 1769626908.956114, 'last_price_update_time': 1769626908.956128, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119030424') HTTP/1.1" 204 0
2026-01-28 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fd5f0383-ea70-5021-852c-0acb413e40ad with identifier: 119045926
2026-01-28 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fd5f0383-ea70-5021-852c-0acb413e40ad with identifier: 119045926
2026-01-28 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fd5f0383-ea70-5021-852c-0acb413e40ad with identifier: 119045926 to the API
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fd5f0383-ea70-5021-852c-0acb413e40ad%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fd5f0383-ea70-5021-852c-0acb413e40ad: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119045926?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'RED',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fd5f0383-ea70-5021-852c-0acb413e40ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YJ69OBF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119045926',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MAZDA',
'model': 'MAZDA3 SALOON',
'odometer': 31921,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-15',
'seller_name': 'UKCGR - Premium',
'title': 'MAZDA MAZDA3 SALOON 2.0 Skyactiv-X MHEV GT Sport Tech 4dr Auto',
'transmission': 'automatic',
'trim': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119045926%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [astonbarclay.gb] INFO: Saving data for 119045926: {'created_time': 1769626909.334962, 'last_price_update_time': 1769626909.334974, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119045926') HTTP/1.1" 204 0
2026-01-28 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61ca1182-222c-588f-abbc-8ce3a5e7196e with identifier: 118948685
2026-01-28 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61ca1182-222c-588f-abbc-8ce3a5e7196e with identifier: 118948685
2026-01-28 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 61ca1182-222c-588f-abbc-8ce3a5e7196e with identifier: 118948685 to the API
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2761ca1182-222c-588f-abbc-8ce3a5e7196e%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 61ca1182-222c-588f-abbc-8ce3a5e7196e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118948685?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 210,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '61ca1182-222c-588f-abbc-8ce3a5e7196e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LO71RFZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948685',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'AUDI',
'model': 'Q7 DIESEL ESTATE',
'odometer': 31969,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-15',
'seller_name': 'Hatfields Group',
'title': 'AUDI Q7 DIESEL ESTATE 50 TDI Quattro S Line 5dr Tiptronic',
'transmission': 'automatic',
'trim': '50 TDI Quattro S Line 5dr Tiptronic',
'vin': None,
'year': 2022}
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948685%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [astonbarclay.gb] INFO: Saving data for 118948685: {'auction_closing_time': 1770123600.0, 'created_time': 1769195010.302152, 'last_price_update_time': 1769626909.632258}
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948685') HTTP/1.1" 204 0
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 119028633
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119028633%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [astonbarclay.gb] INFO: Scrape type for 119028633: 1
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Febd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054500?view=catalogue)
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119026534?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319042ea50>
2026-01-28 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bcb50>
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252Ff889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a62c90>
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903f3f90>
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fd5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190208090>
2026-01-28 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 118917302
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118917302%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [astonbarclay.gb] INFO: Scrape type for 118917302: 1
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fb8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Ffa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319016b8d0>
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fe67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904fc6d0>
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 118918193
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918193%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [astonbarclay.gb] INFO: Scrape type for 118918193: 1
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Fdff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Ff7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F676722c7-f070-4986-b416-9b668f950a51_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 119022584
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022584%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [astonbarclay.gb] INFO: Scrape type for 119022584: 1
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Fe445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Ffc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119034053?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190d134d0>
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3192e7df90>
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009cad0>
2026-01-28 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL21UHT%252F2026-01-28%252Fimage%252F6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55
2026-01-28 19:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eab6f08-199a-5f3b-94cb-a3f28d049e55, skipping ID generation
2026-01-28 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with scrape type 1
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9eab6f08-199a-5f3b-94cb-a3f28d049e55 from tracking dictionaries
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9eab6f08-199a-5f3b-94cb-a3f28d049e55 sending to next pipeline
2026-01-28 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9eab6f08-199a-5f3b-94cb-a3f28d049e55, identifier: 119054500
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191958b50>
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119026534, 'registration': 'LM72SYX', 'account': 'WBA002', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 3 5dr DCT', 'mileage': 24972, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and minor dents/scratches', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119026534, 'registration': 'LM72SYX', 'account': 'WBA002', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 3 5dr DCT', 'mileage': 24972, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and minor dents/scratches', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c with identifier: 119026534
2026-01-28 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c with scrape type 1
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c
2026-01-28 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c
2026-01-28 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c, identifier: 119026534
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900f94d0>
2026-01-28 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fa26c690a-b71a-4506-be73-80327b095a75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190495090>
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fb875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c6d90>
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252Fb7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904cd7d0>
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fdf4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with identifier: 119054500
2026-01-28 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with identifier: 119054500
2026-01-28 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9eab6f08-199a-5f3b-94cb-a3f28d049e55 with identifier: 119054500 to the API
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '9eab6f08-199a-5f3b-94cb-a3f28d049e55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LL21UHT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119054500',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'KIA',
'model': 'CEED HATCHBACK',
'odometer': 22622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30153,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/3009d499-e9ce-462e-980f-e01ff49bedc6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27335,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/d159e375-208b-45ef-a305-8027530cd01a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31540,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/42fb2864-dc5c-4e61-b910-9dce6b92ab01_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30464,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f370babc-25f7-4969-b6d1-02cd942954dc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46355,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/cac27466-621f-4100-bbbe-996725982442_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89601,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/29a25937-f976-4991-8ed1-12d2bf7aa70c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92915,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/fad9bc1c-969f-4972-b6e0-e9e81b55a6ca_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46230,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/6d13846d-7e04-4dc7-81a7-b91b49146260_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab6f08-199a-5f3b-94cb-a3f28d049e55/9eab6f08-199a-5f3b-94cb-a3f28d049e55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42365,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LL21UHT/2026-01-28/image/f889f5f3-ee4b-4596-a1c6-9c6687bbe8b8_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-23',
'seller_name': 'Mercedes-Benz South West',
'title': 'KIA CEED HATCHBACK 1.0T GDi ISG 2 5dr',
'transmission': 'manual',
'trim': '1.0T GDi ISG 2 5dr',
'vin': None,
'year': 2021}
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054500%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [astonbarclay.gb] INFO: Saving data for 119054500: {'created_time': 1769626915.384425, 'last_price_update_time': 1769626915.384437, 'auction_closing_time': 1770198300.0}
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119054500') HTTP/1.1" 204 0
2026-01-28 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c with identifier: 119026534
2026-01-28 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c with identifier: 119026534
2026-01-28 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c with identifier: 119026534 to the API
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2768c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119026534?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '68c3fcbc-8c0f-59d2-8bd6-9ac5194e7a7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LM72SYX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119026534',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'KIA',
'model': 'NIRO ESTATE',
'odometer': 24972,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-30',
'seller_name': 'UKCGR - Premium',
'title': 'KIA NIRO ESTATE 1.6 GDi Hybrid 3 5dr DCT',
'transmission': 'automatic',
'trim': '1.6 GDi Hybrid 3 5dr DCT',
'vin': None,
'year': 2022}
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119026534%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [astonbarclay.gb] INFO: Saving data for 119026534: {'created_time': 1769626915.748523, 'last_price_update_time': 1769626915.748536, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119026534') HTTP/1.1" 204 0
2026-01-28 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 119021595
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119021595%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [astonbarclay.gb] INFO: Scrape type for 119021595: 1
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Ffbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fa43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119032831?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903088d0>
2026-01-28 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190212c50>
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190213710>
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fb6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319051cb10>
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190212910>
2026-01-28 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319183da50>
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:01:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119034053, 'registration': 'RF19YSM', 'account': 'WBA002', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d S 5dr Auto', 'mileage': 79045, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-04-13', 'fuel': 'Diesel', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/11d69689-e244-4870-9d4e-ad608bc103e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119034053, 'registration': 'RF19YSM', 'account': 'WBA002', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d S 5dr Auto', 'mileage': 79045, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-04-13', 'fuel': 'Diesel', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/11d69689-e244-4870-9d4e-ad608bc103e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b055f338-b766-5255-a9c9-0da41487d318 with identifier: 119034053
2026-01-28 19:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b055f338-b766-5255-a9c9-0da41487d318 with scrape type 1
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b055f338-b766-5255-a9c9-0da41487d318
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b055f338-b766-5255-a9c9-0da41487d318
2026-01-28 19:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b055f338-b766-5255-a9c9-0da41487d318, identifier: 119034053
2026-01-28 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 119032588
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119032588%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [astonbarclay.gb] INFO: Scrape type for 119032588: 1
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fc42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fc02706d2-3305-4388-8645-6895325ddb58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252Fbe96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b055f338-b766-5255-a9c9-0da41487d318 with identifier: 119034053
2026-01-28 19:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b055f338-b766-5255-a9c9-0da41487d318 with identifier: 119034053
2026-01-28 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b055f338-b766-5255-a9c9-0da41487d318 with identifier: 119034053 to the API
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b055f338-b766-5255-a9c9-0da41487d318%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b055f338-b766-5255-a9c9-0da41487d318: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119034053?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 162,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b055f338-b766-5255-a9c9-0da41487d318',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RF19YSM',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119034053',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'JAGUAR',
'model': 'E-PACE DIESEL ESTATE',
'odometer': 79045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-13',
'seller_name': 'UKCGR - Premium',
'title': 'JAGUAR E-PACE DIESEL ESTATE 2.0d S 5dr Auto',
'transmission': 'automatic',
'trim': '2.0d S 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034053%27 HTTP/1.1" 200 None
2026-01-28 19:01:57 [astonbarclay.gb] INFO: Saving data for 119034053: {'created_time': 1769626917.891775, 'last_price_update_time': 1769626917.891785, 'auction_closing_time': 1770199200.0}
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119034053') HTTP/1.1" 204 0
2026-01-28 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901977d0>
2026-01-28 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252Fed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119019376, 'registration': 'RJ68LXU', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr', 'mileage': 33838, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/12a4971d-82d8-4cd9-8df6-f7aec150cf5b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119019376, 'registration': 'RJ68LXU', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr', 'mileage': 33838, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/12a4971d-82d8-4cd9-8df6-f7aec150cf5b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with identifier: 119019376
2026-01-28 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with scrape type 1
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:01:58 [astonbarclay.gb] INFO: Found listing with ID: 119037890
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037890%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [astonbarclay.gb] INFO: Scrape type for 119037890: 1
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fe63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901179d0>
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190361d90>
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190361e10>
2026-01-28 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319040d410>
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190288850>
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600 saved to cache
2026-01-28 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190052990>
2026-01-28 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Febd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028bd10>
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119032831, 'registration': 'ST17GVP', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 68487, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-10', 'fuel': 'Diesel', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce9599a8-88e7-4f8d-b059-761cf0d0c045.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119032831, 'registration': 'ST17GVP', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 68487, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-10', 'fuel': 'Diesel', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce9599a8-88e7-4f8d-b059-761cf0d0c045.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f698796-5d6d-5584-87a4-1662c6463ef6 with identifier: 119032831
2026-01-28 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f698796-5d6d-5584-87a4-1662c6463ef6 with scrape type 1
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4f698796-5d6d-5584-87a4-1662c6463ef6
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4f698796-5d6d-5584-87a4-1662c6463ef6
2026-01-28 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f698796-5d6d-5584-87a4-1662c6463ef6, identifier: 119032831
2026-01-28 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fbc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f698796-5d6d-5584-87a4-1662c6463ef6 with identifier: 119032831
2026-01-28 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f698796-5d6d-5584-87a4-1662c6463ef6 with identifier: 119032831
2026-01-28 19:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4f698796-5d6d-5584-87a4-1662c6463ef6 with identifier: 119032831 to the API
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274f698796-5d6d-5584-87a4-1662c6463ef6%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4f698796-5d6d-5584-87a4-1662c6463ef6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:01:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119032831?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4f698796-5d6d-5584-87a4-1662c6463ef6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ST17GVP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119032831',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'RENAULT',
'model': 'KADJAR DIESEL HATCHBACK',
'odometer': 68487,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-10',
'seller_name': 'UKCGR - Premium',
'title': 'RENAULT KADJAR DIESEL HATCHBACK 1.5 dCi Signature Nav 5dr EDC',
'transmission': 'automatic',
'trim': '1.5 dCi Signature Nav 5dr EDC',
'vin': None,
'year': 2017}
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119032831%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [astonbarclay.gb] INFO: Saving data for 119032831: {'created_time': 1769626920.743253, 'last_price_update_time': 1769626920.743264, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119032831') HTTP/1.1" 204 0
2026-01-28 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 119052095
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052095%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [astonbarclay.gb] INFO: Scrape type for 119052095: 1
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fe067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900cb790>
2026-01-28 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029737?view=catalogue)
2026-01-28 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:01 [astonbarclay.gb] INFO: Found listing with ID: 119054061
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054061%27 HTTP/1.1" 200 None
2026-01-28 19:02:01 [astonbarclay.gb] INFO: Scrape type for 119054061: 1
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Faf397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190338850>
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252F676722c7-f070-4986-b416-9b668f950a51_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191929810>
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Ff7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190052750>
2026-01-28 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837da250>
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Fdff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190378e10>
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901317d0>
2026-01-28 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Ffc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319033b5d0>
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028bb50>
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 118993629
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118993629%27 HTTP/1.1" 200 None
2026-01-28 19:02:03 [astonbarclay.gb] INFO: Scrape type for 118993629: 0
2026-01-28 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 119030829
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030829%27 HTTP/1.1" 200 None
2026-01-28 19:02:03 [astonbarclay.gb] INFO: Scrape type for 119030829: 1
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d90d0>
2026-01-28 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904cf210>
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF23VVR%252F2026-01-28%252Fimage%252F66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429
2026-01-28 19:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429, skipping ID generation
2026-01-28 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with scrape type 1
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 from tracking dictionaries
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 sending to next pipeline
2026-01-28 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429, identifier: 119029737
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190638810>
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Ffa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319020cad0>
2026-01-28 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Fe445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190531dd0>
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 119037033
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037033%27 HTTP/1.1" 200 None
2026-01-28 19:02:05 [astonbarclay.gb] INFO: Scrape type for 119037033: 1
2026-01-28 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with identifier: 119029737
2026-01-28 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with identifier: 119029737
2026-01-28 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5d6f6dac-0e43-58c9-a8c7-dd114b66e429 with identifier: 119029737 to the API
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5d6f6dac-0e43-58c9-a8c7-dd114b66e429: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Hybrid Electric',
'id': '5d6f6dac-0e43-58c9-a8c7-dd114b66e429',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EF23VVR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119029737',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FIESTA TITANIUM X TURBO M',
'odometer': 21559,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34442,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/4d1fdbfa-3ffe-4ba5-8ee1-34eaba6bf3b6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36474,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/d5646583-dfba-4e1d-8af4-4c2692e2205e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31933,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2fca212a-bc45-4513-b6b6-c83bf13d9681_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32663,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/5c3f2d99-534b-411b-9c27-604f15943433_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32352,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/b6f68a6e-9e87-484f-afb1-f4caf142f00a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36076,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/9a784ecf-db91-4c0a-9119-1bb762f2b50c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41433,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/ed909240-17c6-4776-bf5d-b0f195311bb4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47282,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/607128c7-3e8f-44a3-ac10-bc3f68c67a74_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42120,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/66264125-b7e4-4283-9ccc-c5a0dd692d3b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6f6dac-0e43-58c9-a8c7-dd114b66e429/5d6f6dac-0e43-58c9-a8c7-dd114b66e429_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47895,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EF23VVR/2026-01-28/image/2ff64e17-d883-414f-9feb-5b87e1ae9bdf_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-17',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FIESTA TITANIUM X TURBO M None',
'transmission': 'manual',
'trim': None,
'vin': None,
'year': 2023}
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119029737%27 HTTP/1.1" 200 None
2026-01-28 19:02:05 [astonbarclay.gb] INFO: Saving data for 119029737: {'created_time': 1769626925.844804, 'last_price_update_time': 1769626925.844816, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119029737') HTTP/1.1" 204 0
2026-01-28 19:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:05 [scrapy.extensions.logstats] INFO: Crawled 131 pages (at 55 pages/min), scraped 44 items (at 25 items/min)
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 119042202
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042202%27 HTTP/1.1" 200 None
2026-01-28 19:02:05 [astonbarclay.gb] INFO: Scrape type for 119042202: 1
2026-01-28 19:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191c25750>
2026-01-28 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252Fbe96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319013e550>
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fc02706d2-3305-4388-8645-6895325ddb58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bc690>
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fa43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e0b10>
2026-01-28 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fe63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904703d0>
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bcdd0>
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a2ebd0>
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fa2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183750510>
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fc42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 119042569
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042569%27 HTTP/1.1" 200 None
2026-01-28 19:02:08 [astonbarclay.gb] INFO: Scrape type for 119042569: 1
2026-01-28 19:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034643?view=catalogue)
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119035154?view=catalogue)
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Ff1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190053350>
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319037aa90>
2026-01-28 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190378290>
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190474950>
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fbc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 119033416
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033416%27 HTTP/1.1" 200 None
2026-01-28 19:02:09 [astonbarclay.gb] INFO: Scrape type for 119033416: 1
2026-01-28 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119030851?view=catalogue)
2026-01-28 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fd282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 119044738
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044738%27 HTTP/1.1" 200 None
2026-01-28 19:02:09 [astonbarclay.gb] INFO: Scrape type for 119044738: 1
2026-01-28 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119054061?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119037890?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190626b50>
2026-01-28 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252Fef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905269d0>
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Faf397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e6c10>
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318372a790>
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190525490>
2026-01-28 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW21HYL%252F2026-01-28%252Fimage%252Fe067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bd15f53-45f8-587c-9d32-17c545e0afff
2026-01-28 19:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bd15f53-45f8-587c-9d32-17c545e0afff, skipping ID generation
2026-01-28 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd15f53-45f8-587c-9d32-17c545e0afff with scrape type 1
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bd15f53-45f8-587c-9d32-17c545e0afff from tracking dictionaries
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bd15f53-45f8-587c-9d32-17c545e0afff sending to next pipeline
2026-01-28 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6bd15f53-45f8-587c-9d32-17c545e0afff, identifier: 119034643
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191959e10>
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLR67YDN%252F2026-01-28%252Fimage%252F3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 629a1267-5e43-5f14-945b-ea775c726337
2026-01-28 19:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 629a1267-5e43-5f14-945b-ea775c726337, skipping ID generation
2026-01-28 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 629a1267-5e43-5f14-945b-ea775c726337 with scrape type 1
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 629a1267-5e43-5f14-945b-ea775c726337 from tracking dictionaries
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 629a1267-5e43-5f14-945b-ea775c726337 sending to next pipeline
2026-01-28 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 629a1267-5e43-5f14-945b-ea775c726337, identifier: 119035154
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119022584, 'registration': 'KM20ZBD', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 63602, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-18', 'fuel': 'Diesel', 'motExpiry': '2027-01-12', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/545c810c-14a3-42af-af36-85692c2cc942.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119022584, 'registration': 'KM20ZBD', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 63602, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-18', 'fuel': 'Diesel', 'motExpiry': '2027-01-12', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/545c810c-14a3-42af-af36-85692c2cc942.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 987fa600-e67f-5345-83e8-a3729bb54e8e with identifier: 119022584
2026-01-28 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 987fa600-e67f-5345-83e8-a3729bb54e8e with scrape type 1
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118918193, 'registration': 'LO69VJJ', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS SALOON', 'derivative': 'C300 Sport 4dr 9G-Tronic', 'mileage': 22645, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-04', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600', 'https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600', 'https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600', 'https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600', 'https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600', 'https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600', 'https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600', 'https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d774beca-cee5-4bd4-ba3a-3a9d0b24b7f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118918193, 'registration': 'LO69VJJ', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS SALOON', 'derivative': 'C300 Sport 4dr 9G-Tronic', 'mileage': 22645, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-04', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600', 'https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600', 'https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600', 'https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600', 'https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600', 'https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600', 'https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600', 'https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d774beca-cee5-4bd4-ba3a-3a9d0b24b7f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with identifier: 118918193
2026-01-28 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with scrape type 1
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600 not downloaded yet
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119032588, 'registration': 'EY20KJO', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 100 Acenta 5dr Xtronic', 'mileage': 10323, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/94f3d1b7-b138-4f2e-9889-71a47b36015c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119032588, 'registration': 'EY20KJO', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 100 Acenta 5dr Xtronic', 'mileage': 10323, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/94f3d1b7-b138-4f2e-9889-71a47b36015c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35826001-bb3e-5012-8dbf-d59b7566223a with identifier: 119032588
2026-01-28 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35826001-bb3e-5012-8dbf-d59b7566223a with scrape type 1
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fe51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6bd15f53-45f8-587c-9d32-17c545e0afff with identifier: 119034643
2026-01-28 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6bd15f53-45f8-587c-9d32-17c545e0afff with identifier: 119034643
2026-01-28 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6bd15f53-45f8-587c-9d32-17c545e0afff with identifier: 119034643 to the API
2026-01-28 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6bd15f53-45f8-587c-9d32-17c545e0afff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KW21HYL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119034643',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS DIESEL HATCHBACK',
'odometer': 36949,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30710,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/104efbf3-8fb5-40f7-9a2c-804f527f4cd6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29908,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/1f9bfe19-b716-4e78-96ef-a9b8652505b0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31314,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/95fbf884-e21b-4785-8344-bc3ace298e43_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30845,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/676722c7-f070-4986-b416-9b668f950a51_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49127,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/fc9e8049-214a-4970-b40f-9042f409b4fb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54971,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/a43c5d42-839c-4135-bebf-db2f35215705_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47084,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/c02706d2-3305-4388-8645-6895325ddb58_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54232,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e63023e7-8512-4807-a453-7df103e3f10f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46947,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/e067d4c9-b4f6-4401-8a6c-6174175f2224_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd15f53-45f8-587c-9d32-17c545e0afff/6bd15f53-45f8-587c-9d32-17c545e0afff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48861,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KW21HYL/2026-01-28/image/af397f85-3645-4db8-81d9-f899c6d95234_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-15',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A180d [2.0] AMG Line Premium '
'Plus 5dr Auto',
'transmission': 'automatic',
'trim': 'A180d [2.0] AMG Line Premium Plus 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034643%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Saving data for 119034643: {'created_time': 1769626932.191985, 'last_price_update_time': 1769626932.191996, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119034643') HTTP/1.1" 204 0
2026-01-28 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 629a1267-5e43-5f14-945b-ea775c726337 with identifier: 119035154
2026-01-28 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 629a1267-5e43-5f14-945b-ea775c726337 with identifier: 119035154
2026-01-28 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 629a1267-5e43-5f14-945b-ea775c726337 with identifier: 119035154 to the API
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '629a1267-5e43-5f14-945b-ea775c726337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR67YDN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119035154',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'ASTRA HATCHBACK',
'odometer': 48630,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35957,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/137ce6d1-0581-47e4-8c9f-63b3eab83dea_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32268,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/27f2f0f8-a376-48cd-be01-1663a7204874_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34175,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3cb43890-375b-43d5-968c-6a0fe9fde7f0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29431,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/1e761316-551c-446b-9e6e-1b2196e49da4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47194,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5068f861-c45f-4f10-8ee1-0a5526498780_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45857,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/377f64a3-db7c-4dd0-9410-f22c684b8f3d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53559,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/be96a4f9-76b7-42b8-aa76-4dc0a9a6b50c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42765,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/5b51ceb7-b4ba-4201-b618-0b68fe7774fb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_629a1267-5e43-5f14-945b-ea775c726337/629a1267-5e43-5f14-945b-ea775c726337_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48157,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LR67YDN/2026-01-28/image/3c4b7d21-dc0d-44a0-8650-da925fcbb292_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-24',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL ASTRA HATCHBACK 1.4T 16V 150 SRi 5dr',
'transmission': 'manual',
'trim': '1.4T 16V 150 SRi 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119035154%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Saving data for 119035154: {'created_time': 1769626932.665682, 'last_price_update_time': 1769626932.665692, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119035154') HTTP/1.1" 204 0
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119051634?view=catalogue)
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 119030718
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030718%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Scrape type for 119030718: 1
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F641a05f9-8064-4c59-83ab-43c88101ce91.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Ffa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119030829?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 119057133
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119057133%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [astonbarclay.gb] INFO: Scrape type for 119057133: 1
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Faa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190317f90>
2026-01-28 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWD71ZBF%252F2026-01-28%252Fimage%252F43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50f02385-4490-54b1-b24e-f22fee829845
2026-01-28 19:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50f02385-4490-54b1-b24e-f22fee829845, skipping ID generation
2026-01-28 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f02385-4490-54b1-b24e-f22fee829845 with scrape type 1
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 50f02385-4490-54b1-b24e-f22fee829845 from tracking dictionaries
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50f02385-4490-54b1-b24e-f22fee829845 sending to next pipeline
2026-01-28 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 50f02385-4490-54b1-b24e-f22fee829845, identifier: 119030851
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900bcd90>
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318370ae50>
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252F00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119054061, 'registration': 'EO70KUP', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Play TSS 5dr', 'mileage': 11516, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-28', 'fuel': 'Petrol', 'motExpiry': '2027-01-22', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e924ccb9-979c-4f02-b3ba-06804ef890ab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119054061, 'registration': 'EO70KUP', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Play TSS 5dr', 'mileage': 11516, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-28', 'fuel': 'Petrol', 'motExpiry': '2027-01-22', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e924ccb9-979c-4f02-b3ba-06804ef890ab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 721237f3-f3ea-5c3e-842d-b3254fa73dac with identifier: 119054061
2026-01-28 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721237f3-f3ea-5c3e-842d-b3254fa73dac with scrape type 1
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 721237f3-f3ea-5c3e-842d-b3254fa73dac
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 721237f3-f3ea-5c3e-842d-b3254fa73dac
2026-01-28 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 721237f3-f3ea-5c3e-842d-b3254fa73dac, identifier: 119054061
2026-01-28 19:02:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119037890, 'registration': 'EY18XRV', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 60568, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5bc0f25e-cb56-45a1-a175-c421269405ed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119037890, 'registration': 'EY18XRV', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 60568, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5bc0f25e-cb56-45a1-a175-c421269405ed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6 with identifier: 119037890
2026-01-28 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6 with scrape type 1
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6
2026-01-28 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6
2026-01-28 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6, identifier: 119037890
2026-01-28 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 50f02385-4490-54b1-b24e-f22fee829845 with identifier: 119030851
2026-01-28 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 50f02385-4490-54b1-b24e-f22fee829845 with identifier: 119030851
2026-01-28 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 50f02385-4490-54b1-b24e-f22fee829845 with identifier: 119030851 to the API
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 173,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '50f02385-4490-54b1-b24e-f22fee829845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WD71ZBF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119030851',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'KIA',
'model': 'SPORTAGE DIESEL ESTATE',
'odometer': 28731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31207,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/0b4d5605-402e-431c-891b-016ce1c1ab7e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36320,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ebd11e75-6b44-4fb5-9dec-72b8f4a03916_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35269,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/808c8720-99e3-4a4f-9bf7-2d379791f612_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37881,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/f7655072-0302-430b-ae1e-fba32d315d73_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39816,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/701e494b-519e-4599-89bc-7ecc092be5e7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53035,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ea668641-a88e-402c-ae8c-15945ba8e1f4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67465,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/c42e25b3-2e75-4249-8af7-fe3905df89b2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62092,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/9f76a5ef-a21b-4746-bcf3-127b28b19d5f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44871,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/43957411-5d7f-4ece-b907-b4958a8103d8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f02385-4490-54b1-b24e-f22fee829845/50f02385-4490-54b1-b24e-f22fee829845_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43835,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WD71ZBF/2026-01-28/image/ef69d823-15d0-4c00-b49a-3f4673c0b46f_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-11',
'seller_name': 'UKCGR - Premium',
'title': 'KIA SPORTAGE DIESEL ESTATE 1.6 CRDi 48V ISG GT-Line S 5dr DCT Auto '
'[AWD]',
'transmission': 'automatic',
'trim': '1.6 CRDi 48V ISG GT-Line S 5dr DCT Auto [AWD]',
'vin': None,
'year': 2021}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030851%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [astonbarclay.gb] INFO: Saving data for 119030851: {'created_time': 1769626934.326029, 'last_price_update_time': 1769626934.32604, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119030851') HTTP/1.1" 204 0
2026-01-28 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 721237f3-f3ea-5c3e-842d-b3254fa73dac with identifier: 119054061
2026-01-28 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 721237f3-f3ea-5c3e-842d-b3254fa73dac with identifier: 119054061
2026-01-28 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 721237f3-f3ea-5c3e-842d-b3254fa73dac with identifier: 119054061 to the API
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27721237f3-f3ea-5c3e-842d-b3254fa73dac%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 721237f3-f3ea-5c3e-842d-b3254fa73dac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119054061?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '721237f3-f3ea-5c3e-842d-b3254fa73dac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EO70KUP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119054061',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'TOYOTA',
'model': 'AYGO HATCHBACK',
'odometer': 11516,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seller_name': 'UKCGR - Premium',
'title': 'TOYOTA AYGO HATCHBACK 1.0 VVT-i X-Play TSS 5dr',
'transmission': 'manual',
'trim': '1.0 VVT-i X-Play TSS 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054061%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [astonbarclay.gb] INFO: Saving data for 119054061: {'created_time': 1769626934.620432, 'last_price_update_time': 1769626934.620447, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119054061') HTTP/1.1" 204 0
2026-01-28 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6 with identifier: 119037890
2026-01-28 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6 with identifier: 119037890
2026-01-28 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6 with identifier: 119037890 to the API
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278c8617ea-a8f4-5e04-a31c-2d59920ea2c6%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8c8617ea-a8f4-5e04-a31c-2d59920ea2c6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119037890?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8c8617ea-a8f4-5e04-a31c-2d59920ea2c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EY18XRV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119037890',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FOCUS HATCHBACK',
'odometer': 60568,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-17',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 125 Titanium 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037890%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [astonbarclay.gb] INFO: Saving data for 119037890: {'created_time': 1769626934.90297, 'last_price_update_time': 1769626934.902982, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119037890') HTTP/1.1" 204 0
2026-01-28 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 119088693
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119088693%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [astonbarclay.gb] INFO: Scrape type for 119088693: 1
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fe6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600 not downloaded yet
2026-01-28 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319040ca10>
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_12.jpg HTTP/1.1" 201 0
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fb8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191880190>
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252F2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319030b710>
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD67EYM%252F2026-01-28%252Fimage%252Ffbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5078cd33-e5ee-5589-9316-e7d686f2c341
2026-01-28 19:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5078cd33-e5ee-5589-9316-e7d686f2c341, skipping ID generation
2026-01-28 19:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5078cd33-e5ee-5589-9316-e7d686f2c341 with scrape type 1
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5078cd33-e5ee-5589-9316-e7d686f2c341 from tracking dictionaries
2026-01-28 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5078cd33-e5ee-5589-9316-e7d686f2c341 sending to next pipeline
2026-01-28 19:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5078cd33-e5ee-5589-9316-e7d686f2c341, identifier: 119051634
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190052590>
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fa2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119019376?view=catalogue)
2026-01-28 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5078cd33-e5ee-5589-9316-e7d686f2c341 with identifier: 119051634
2026-01-28 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5078cd33-e5ee-5589-9316-e7d686f2c341 with identifier: 119051634
2026-01-28 19:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5078cd33-e5ee-5589-9316-e7d686f2c341 with identifier: 119051634 to the API
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Petrol',
'id': '5078cd33-e5ee-5589-9316-e7d686f2c341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LD67EYM',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119051634',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'TOYOTA',
'model': 'AYGO HATCHBACK',
'odometer': 33806,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20220,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/714911ba-aa3f-4ffc-861e-16408857b993_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19314,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/97ddd55a-6570-4c04-873e-870597d14444_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26327,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fa9c6265-dd31-4e0c-935a-9fe44d5d67c2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21173,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/dff7a51a-2723-458c-9601-33e6a14e10d9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44300,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/e445cce7-ed42-4da7-9f01-118aaba90e1d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30757,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/fbd8419f-e64a-49b9-8daf-fbab63133905_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41947,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/9fb276e7-0dee-4186-b38e-50496830e056_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44576,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/13309fc3-d57f-4743-8990-fc142f2d8dc2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5078cd33-e5ee-5589-9316-e7d686f2c341/5078cd33-e5ee-5589-9316-e7d686f2c341_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48563,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/LD67EYM/2026-01-28/image/00239951-2766-4cea-a44f-38bd2c7a2678_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-16',
'seller_name': 'UKCGR - Premium',
'title': 'TOYOTA AYGO HATCHBACK 1.0 VVT-i X-Play 5dr',
'transmission': 'manual',
'trim': '1.0 VVT-i X-Play 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119051634%27 HTTP/1.1" 200 None
2026-01-28 19:02:16 [astonbarclay.gb] INFO: Saving data for 119051634: {'created_time': 1769626936.719838, 'last_price_update_time': 1769626936.719849, 'auction_closing_time': 1770123600.0}
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119051634') HTTP/1.1" 204 0
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319042e050>
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_11.jpg HTTP/1.1" 201 0
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319051e650>
2026-01-28 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Ff1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119030829, 'registration': 'EA68PUY', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi SE Nav 5dr 2WD', 'mileage': 75552, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-28', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/daccfb04-f804-484e-ae99-7f1f36104a82.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119030829, 'registration': 'EA68PUY', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi SE Nav 5dr 2WD', 'mileage': 75552, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-28', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/daccfb04-f804-484e-ae99-7f1f36104a82.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1568b992-47ef-58a7-8d79-e9ec6579b14b with identifier: 119030829
2026-01-28 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1568b992-47ef-58a7-8d79-e9ec6579b14b with scrape type 1
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1568b992-47ef-58a7-8d79-e9ec6579b14b
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1568b992-47ef-58a7-8d79-e9ec6579b14b
2026-01-28 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1568b992-47ef-58a7-8d79-e9ec6579b14b, identifier: 119030829
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119037033, 'registration': 'EU22KMO', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr', 'mileage': 16904, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a7bc8652-a97a-40ca-9663-14861f7a1bb5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119037033, 'registration': 'EU22KMO', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr', 'mileage': 16904, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a7bc8652-a97a-40ca-9663-14861f7a1bb5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc69414-269e-5114-b87c-ba232f407e11 with identifier: 119037033
2026-01-28 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc69414-269e-5114-b87c-ba232f407e11 with scrape type 1
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Found listing with ID: 119020038
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119020038%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Scrape type for 119020038: 1
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fedf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600 not downloaded yet
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1568b992-47ef-58a7-8d79-e9ec6579b14b with identifier: 119030829
2026-01-28 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1568b992-47ef-58a7-8d79-e9ec6579b14b with identifier: 119030829
2026-01-28 19:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1568b992-47ef-58a7-8d79-e9ec6579b14b with identifier: 119030829 to the API
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271568b992-47ef-58a7-8d79-e9ec6579b14b%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1568b992-47ef-58a7-8d79-e9ec6579b14b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119030829?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 162,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1568b992-47ef-58a7-8d79-e9ec6579b14b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EA68PUY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119030829',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'HYUNDAI',
'model': 'TUCSON ESTATE',
'odometer': 75552,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seller_name': 'UKCGR - Premium',
'title': 'HYUNDAI TUCSON ESTATE 1.6 GDi SE Nav 5dr 2WD',
'transmission': 'manual',
'trim': '1.6 GDi SE Nav 5dr 2WD',
'vin': None,
'year': 2018}
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030829%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [astonbarclay.gb] INFO: Saving data for 119030829: {'created_time': 1769626937.686855, 'last_price_update_time': 1769626937.686865, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119030829') HTTP/1.1" 204 0
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fbc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191af4ed0>
2026-01-28 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191c17c10>
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319053a890>
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fd282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 119017250
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119017250%27 HTTP/1.1" 200 None
2026-01-28 19:02:18 [astonbarclay.gb] INFO: Scrape type for 119017250: 1
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600 not downloaded yet
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Fc7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900fbd50>
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903b84d0>
2026-01-28 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ68LXU%252F2026-01-28%252Fimage%252Fe51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc
2026-01-28 19:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc, skipping ID generation
2026-01-28 19:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with scrape type 1
2026-01-28 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc from tracking dictionaries
2026-01-28 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d8b0d08-f9da-5819-af1f-e98c1907c7dc sending to next pipeline
2026-01-28 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc, identifier: 119019376
2026-01-28 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fc880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with identifier: 119019376
2026-01-28 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with identifier: 119019376
2026-01-28 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5d8b0d08-f9da-5819-af1f-e98c1907c7dc with identifier: 119019376 to the API
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5d8b0d08-f9da-5819-af1f-e98c1907c7dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RJ68LXU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119019376',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'ASTRA HATCHBACK',
'odometer': 33838,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32425,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/87dcf826-47dd-44f2-992a-8009f941284e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32389,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/bc29d437-e86b-4dcb-a34c-f6b140ecdc5a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32953,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/5e5a7b4f-d9c0-4a78-9f23-b2c8926225b7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31693,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/3ee1d0eb-3fd3-4c3a-951e-94f5301aa8cd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55133,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/9cb7de62-9648-4c41-94db-f9ba53d01a9d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62015,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/2632b31e-a64d-4035-901e-a2f473f66bbf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55360,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/a2cd78f2-80ab-4479-9b16-8819130379d4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46252,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/f1e0ca78-1563-4439-8d1b-f4957b3a8880_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44582,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/d282bcef-ddea-4b28-91ec-86ae592e029b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8b0d08-f9da-5819-af1f-e98c1907c7dc/5d8b0d08-f9da-5819-af1f-e98c1907c7dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50817,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ68LXU/2026-01-28/image/e51cbb8e-b46b-4bdf-bf4e-3f8688e47e9e_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-16',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL ASTRA HATCHBACK 1.4T 16V 150 Elite Nav 5dr',
'transmission': 'manual',
'trim': '1.4T 16V 150 Elite Nav 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119019376%27 HTTP/1.1" 200 None
2026-01-28 19:02:19 [astonbarclay.gb] INFO: Saving data for 119019376: {'created_time': 1769626939.828713, 'last_price_update_time': 1769626939.828723, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119019376') HTTP/1.1" 204 0
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319032ced0>
2026-01-28 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Ffa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 118997141
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118997141%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Scrape type for 118997141: 0
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 118996198
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118996198%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Scrape type for 118996198: 1
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb7f830d8-9de1-413c-8278-7d6fcffb331d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119042569?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119052095?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119028633, 'registration': 'SE19DFJ', 'account': 'WBA002', 'make': 'PORSCHE', 'model': 'CAYENNE ESTATE', 'derivative': '5dr Tiptronic S', 'mileage': 57154, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-06-27', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 207, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/033cfa89-7cbb-49d3-9d4e-0f25acc9ddb2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119028633, 'registration': 'SE19DFJ', 'account': 'WBA002', 'make': 'PORSCHE', 'model': 'CAYENNE ESTATE', 'derivative': '5dr Tiptronic S', 'mileage': 57154, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-06-27', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 207, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/033cfa89-7cbb-49d3-9d4e-0f25acc9ddb2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97d9b41e-9da4-588a-8871-bf3083faccff with identifier: 119028633
2026-01-28 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d9b41e-9da4-588a-8871-bf3083faccff with scrape type 1
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119042202, 'registration': 'EA24WBZ', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 Advance 5dr Auto', 'mileage': 4487, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e0948af-d015-4061-a96d-97ff413695b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119042202, 'registration': 'EA24WBZ', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 Advance 5dr Auto', 'mileage': 4487, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e0948af-d015-4061-a96d-97ff413695b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with identifier: 119042202
2026-01-28 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with scrape type 1
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118917302, 'registration': 'LM25HYH', 'account': 'MER178', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Hybrid Tekna 5dr Auto', 'mileage': 1567, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-31', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3fe68407-f86e-4169-afad-fdb3f7872d2c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118917302, 'registration': 'LM25HYH', 'account': 'MER178', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Hybrid Tekna 5dr Auto', 'mileage': 1567, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-31', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3fe68407-f86e-4169-afad-fdb3f7872d2c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with identifier: 118917302
2026-01-28 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with scrape type 1
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fd4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190133810>
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31917df9d0>
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Faa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 118989112
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989112%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Scrape type for 118989112: 0
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 119036866
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036866%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [astonbarclay.gb] INFO: Scrape type for 119036866: 1
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fd879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2de57456-df30-40cf-b7a8-625f984a3064.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fe68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190237350>
2026-01-28 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Ff0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183715b50>
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 119037149
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037149%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Scrape type for 119037149: 1
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fb8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fc60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fb89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119044738, 'registration': 'LM17VCZ', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '108 HATCHBACK', 'derivative': '1.2 PureTech GT Line 5dr', 'mileage': 5623, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-08-15', 'fuel': 'Petrol', 'motExpiry': '2026-08-18', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce78715d-142d-42c7-ba09-4571e2564672.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119044738, 'registration': 'LM17VCZ', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '108 HATCHBACK', 'derivative': '1.2 PureTech GT Line 5dr', 'mileage': 5623, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-08-15', 'fuel': 'Petrol', 'motExpiry': '2026-08-18', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce78715d-142d-42c7-ba09-4571e2564672.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b408f9-8256-575d-90bb-2803e6a70eb0 with identifier: 119044738
2026-01-28 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b408f9-8256-575d-90bb-2803e6a70eb0 with scrape type 1
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fb4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119042569, 'registration': 'EA17GDZ', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 Design 5dr Auto', 'mileage': 67859, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bab3f27a-5d8c-47b3-b284-ddc01b9388f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119042569, 'registration': 'EA17GDZ', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 Design 5dr Auto', 'mileage': 67859, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bab3f27a-5d8c-47b3-b284-ddc01b9388f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b021ed-6102-5471-a52f-ecb2a64b256d with identifier: 119042569
2026-01-28 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b021ed-6102-5471-a52f-ecb2a64b256d with scrape type 1
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 04b021ed-6102-5471-a52f-ecb2a64b256d
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 04b021ed-6102-5471-a52f-ecb2a64b256d
2026-01-28 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 04b021ed-6102-5471-a52f-ecb2a64b256d, identifier: 119042569
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119052095, 'registration': 'EU69ZRT', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 AMG Line Edition 5dr Auto', 'mileage': 39262, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-02', 'fuel': 'Petrol', 'motExpiry': '2026-07-31', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fafeffff-75d8-4a4f-8cfa-450ef3f71cf2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119052095, 'registration': 'EU69ZRT', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 AMG Line Edition 5dr Auto', 'mileage': 39262, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-02', 'fuel': 'Petrol', 'motExpiry': '2026-07-31', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fafeffff-75d8-4a4f-8cfa-450ef3f71cf2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5388aaa4-f7e3-5571-8acb-1a9745cc6927 with identifier: 119052095
2026-01-28 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5388aaa4-f7e3-5571-8acb-1a9745cc6927 with scrape type 1
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5388aaa4-f7e3-5571-8acb-1a9745cc6927
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5388aaa4-f7e3-5571-8acb-1a9745cc6927
2026-01-28 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5388aaa4-f7e3-5571-8acb-1a9745cc6927, identifier: 119052095
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119033416, 'registration': 'DH18OFB', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 SE 5dr', 'mileage': 29595, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119033416, 'registration': 'DH18OFB', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 SE 5dr', 'mileage': 29595, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728a1478-bb25-5a4f-8c98-c25873650ae3 with identifier: 119033416
2026-01-28 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728a1478-bb25-5a4f-8c98-c25873650ae3 with scrape type 1
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252Fee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 04b021ed-6102-5471-a52f-ecb2a64b256d with identifier: 119042569
2026-01-28 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 04b021ed-6102-5471-a52f-ecb2a64b256d with identifier: 119042569
2026-01-28 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 04b021ed-6102-5471-a52f-ecb2a64b256d with identifier: 119042569 to the API
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2704b021ed-6102-5471-a52f-ecb2a64b256d%27 HTTP/1.1" 200 None
2026-01-28 19:02:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 04b021ed-6102-5471-a52f-ecb2a64b256d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119042569?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '04b021ed-6102-5471-a52f-ecb2a64b256d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EA17GDZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119042569',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'CORSA HATCHBACK',
'odometer': 67859,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-28',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL CORSA HATCHBACK 1.4 Design 5dr Auto',
'transmission': 'automatic',
'trim': '1.4 Design 5dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042569%27 HTTP/1.1" 200 None
2026-01-28 19:02:22 [astonbarclay.gb] INFO: Saving data for 119042569: {'created_time': 1769626942.202988, 'last_price_update_time': 1769626942.202998, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119042569') HTTP/1.1" 204 0
2026-01-28 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5388aaa4-f7e3-5571-8acb-1a9745cc6927 with identifier: 119052095
2026-01-28 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5388aaa4-f7e3-5571-8acb-1a9745cc6927 with identifier: 119052095
2026-01-28 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5388aaa4-f7e3-5571-8acb-1a9745cc6927 with identifier: 119052095 to the API
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275388aaa4-f7e3-5571-8acb-1a9745cc6927%27 HTTP/1.1" 200 None
2026-01-28 19:02:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5388aaa4-f7e3-5571-8acb-1a9745cc6927: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119052095?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5388aaa4-f7e3-5571-8acb-1a9745cc6927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EU69ZRT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119052095',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'GLA HATCHBACK',
'odometer': 39262,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 180 AMG Line Edition 5dr Auto',
'transmission': 'automatic',
'trim': 'GLA 180 AMG Line Edition 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052095%27 HTTP/1.1" 200 None
2026-01-28 19:02:22 [astonbarclay.gb] INFO: Saving data for 119052095: {'created_time': 1769626942.48843, 'last_price_update_time': 1769626942.488443, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119052095') HTTP/1.1" 204 0
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183730310>
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b88d0>
2026-01-28 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fedf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119021595, 'registration': 'GN18OAC', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 97305, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-04-25', 'fuel': 'Diesel', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0a4f3cf-ad54-43bd-bfda-38a8ee767361.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119021595, 'registration': 'GN18OAC', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 97305, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-04-25', 'fuel': 'Diesel', 'motExpiry': '2027-01-21', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0a4f3cf-ad54-43bd-bfda-38a8ee767361.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ef0e77-ef53-5c98-83db-4613fc882c0c with identifier: 119021595
2026-01-28 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ef0e77-ef53-5c98-83db-4613fc882c0c with scrape type 1
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fbcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 118993174
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118993174%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Scrape type for 118993174: 0
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 119040119
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119040119%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [astonbarclay.gb] INFO: Scrape type for 119040119: 1
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fe758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Fa48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fb19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191819cd0>
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319005bf10>
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fbc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fc0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319047b390>
2026-01-28 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600 saved to cache
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 118870420
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118870420%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Scrape type for 118870420: 0
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 118985399
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118985399%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Scrape type for 118985399: 0
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 119042739
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042739%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [astonbarclay.gb] INFO: Scrape type for 119042739: 1
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fcac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Fcfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fd6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fcff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318373fa10>
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190385f90>
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fc880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318373e910>
2026-01-28 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F641a05f9-8064-4c59-83ab-43c88101ce91.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600 saved to cache
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318373de50>
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252Fc7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F38018611-7021-4330-962e-853b23dd856e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319164e890>
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183610e10>
2026-01-28 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901080d0>
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118777246
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118777246%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118777246: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118883361
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118883361%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118883361: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 119049125
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119049125%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 119049125: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118993124
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118993124%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118993124: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118918671
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918671%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118918671: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118918661
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918661%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118918661: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118918616
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918616%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118918616: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118918607
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918607%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118918607: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118981524
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118981524%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118981524: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118981599
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118981599%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118981599: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118992638
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992638%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118992638: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118994473
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994473%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118994473: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118986101
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118986101%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118986101: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 118993718
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118993718%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 118993718: 0
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 119033241
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033241%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [astonbarclay.gb] INFO: Scrape type for 119033241: 1
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fcb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252Febe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319035cc90>
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319063cc50>
2026-01-28 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Fd4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374cd50>
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600 saved to cache
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bc1d0>
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119057133, 'registration': 'BF19FSG', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr Auto', 'mileage': 19917, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b4ddfe67-add9-485a-933b-89a996893d87.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119057133, 'registration': 'BF19FSG', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 Elite Nav 5dr Auto', 'mileage': 19917, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b4ddfe67-add9-485a-933b-89a996893d87.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe242a8-6e66-56dc-bee1-5c22aec06a39 with identifier: 119057133
2026-01-28 19:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe242a8-6e66-56dc-bee1-5c22aec06a39 with scrape type 1
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119020038, 'registration': 'AY69LXM', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A200d AMG Line Executive 5dr Auto', 'mileage': 36969, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c11b8db-bd8f-44d4-87a9-3d729c1fc1b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119020038, 'registration': 'AY69LXM', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A200d AMG Line Executive 5dr Auto', 'mileage': 36969, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c11b8db-bd8f-44d4-87a9-3d729c1fc1b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with identifier: 119020038
2026-01-28 19:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with scrape type 1
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 118976218
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118976218%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Scrape type for 118976218: 0
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 119033233
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033233%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [astonbarclay.gb] INFO: Scrape type for 119033233: 1
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Ffd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190055990>
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fe68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319164f3d0>
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190276bd0>
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190204f10>
2026-01-28 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252Ff0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fa711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190107510>
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fb89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190238710>
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fb4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900da0d0>
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252Fee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118974872
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974872%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118974872: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118995258
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118995258%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118995258: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118974822
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974822%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118974822: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118986255
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118986255%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118986255: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118983826
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118983826%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118983826: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118992268
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118992268%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118992268: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118987684
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987684%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118987684: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118989665
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989665%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118989665: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118995500
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118995500%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118995500: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118991708
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991708%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118991708: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118987372
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118987372%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118987372: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118984722
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118984722%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118984722: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118974742
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974742%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118974742: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118989255
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118989255%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118989255: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118991037
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118991037%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118991037: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118990766
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118990766%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118990766: 0
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 118953753
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953753%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [astonbarclay.gb] INFO: Scrape type for 118953753: 1
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Faf3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fbafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319032fb90>
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fbcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900e0c10>
2026-01-28 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600 saved to cache
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F723050db-ea28-4828-838b-c5f610deed46_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904b7d10>
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183748b10>
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183787590>
2026-01-28 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 118933600
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118933600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Scrape type for 118933600: 0
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 118973872
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118973872%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Scrape type for 118973872: 0
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 118870799
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118870799%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Scrape type for 118870799: 0
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 118954413
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118954413%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Scrape type for 118954413: 0
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 118519179
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118519179%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [astonbarclay.gb] INFO: Scrape type for 118519179: 2
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Ffe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319051d790>
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191848790>
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fc0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190150bd0>
2026-01-28 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fe76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F50184281-2565-492b-affd-6661d32f96bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904fe690>
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fb19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190139b10>
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Fa48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191813c50>
2026-01-28 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600 saved to cache
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:34 [astonbarclay.gb] INFO: Found listing with ID: 118750135
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118750135%27 HTTP/1.1" 200 None
2026-01-28 19:02:34 [astonbarclay.gb] INFO: Scrape type for 118750135: 1
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fe8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Ff7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183661410>
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183661110>
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fcff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318367a750>
2026-01-28 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fbf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183728cd0>
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fd6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900d8d50>
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F38018611-7021-4330-962e-853b23dd856e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319037a890>
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319195cb90>
2026-01-28 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb7f830d8-9de1-413c-8278-7d6fcffb331d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600 saved to cache
2026-01-28 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 118735717
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735717%27 HTTP/1.1" 200 None
2026-01-28 19:02:36 [astonbarclay.gb] INFO: Scrape type for 118735717: 1
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F87ba9423-143f-4732-8390-69a360e48734_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d3910>
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252Febe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190274490>
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Fcb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Ffea457e7-b37d-465c-8076-c57322871121_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fdc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904b5450>
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903038d0>
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190102e50>
2026-01-28 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:38 [astonbarclay.gb] INFO: Found listing with ID: 118317404
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118317404%27 HTTP/1.1" 200 None
2026-01-28 19:02:38 [astonbarclay.gb] INFO: Scrape type for 118317404: 1
2026-01-28 19:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a6810>
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190131290>
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837f0450>
2026-01-28 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fcf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fd65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e2410>
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904b3650>
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:39 [astonbarclay.gb] INFO: Found listing with ID: 118599413
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118599413%27 HTTP/1.1" 200 None
2026-01-28 19:02:39 [astonbarclay.gb] INFO: Scrape type for 118599413: 0
2026-01-28 19:02:39 [astonbarclay.gb] INFO: Found listing with ID: 118741136
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118741136%27 HTTP/1.1" 200 None
2026-01-28 19:02:39 [astonbarclay.gb] INFO: Scrape type for 118741136: 1
2026-01-28 19:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374df90>
2026-01-28 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a6110>
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fa711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d37d0>
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190194490>
2026-01-28 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fbafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191868c10>
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190320490>
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033416?view=catalogue)
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Found listing with ID: 118651606
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118651606%27 HTTP/1.1" 200 None
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Scrape type for 118651606: 0
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Found listing with ID: 118651665
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118651665%27 HTTP/1.1" 200 None
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Scrape type for 118651665: 0
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Found listing with ID: 118694625
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118694625%27 HTTP/1.1" 200 None
2026-01-28 19:02:41 [astonbarclay.gb] INFO: Scrape type for 118694625: 1
2026-01-28 19:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191beb190>
2026-01-28 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902ea7d0>
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190525a50>
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252F09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900f1c90>
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901543d0>
2026-01-28 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118917302?view=catalogue)
2026-01-28 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119044738?view=catalogue)
2026-01-28 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:43 [astonbarclay.gb] INFO: Found listing with ID: 118687613
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118687613%27 HTTP/1.1" 200 None
2026-01-28 19:02:43 [astonbarclay.gb] INFO: Scrape type for 118687613: 1
2026-01-28 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837f1710>
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F50184281-2565-492b-affd-6661d32f96bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374f1d0>
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fe76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374d290>
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900f8510>
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252Ff7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190361610>
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDH18OFB%252F2026-01-27%252Fimage%252F1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 728a1478-bb25-5a4f-8c98-c25873650ae3
2026-01-28 19:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 728a1478-bb25-5a4f-8c98-c25873650ae3, skipping ID generation
2026-01-28 19:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728a1478-bb25-5a4f-8c98-c25873650ae3 with scrape type 1
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 728a1478-bb25-5a4f-8c98-c25873650ae3 from tracking dictionaries
2026-01-28 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 728a1478-bb25-5a4f-8c98-c25873650ae3 sending to next pipeline
2026-01-28 19:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 728a1478-bb25-5a4f-8c98-c25873650ae3, identifier: 119033416
2026-01-28 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:44 [astonbarclay.gb] INFO: Found listing with ID: 118698130
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118698130%27 HTTP/1.1" 200 None
2026-01-28 19:02:44 [astonbarclay.gb] INFO: Scrape type for 118698130: 1
2026-01-28 19:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 728a1478-bb25-5a4f-8c98-c25873650ae3 with identifier: 119033416
2026-01-28 19:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 728a1478-bb25-5a4f-8c98-c25873650ae3 with identifier: 119033416
2026-01-28 19:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 728a1478-bb25-5a4f-8c98-c25873650ae3 with identifier: 119033416 to the API
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '728a1478-bb25-5a4f-8c98-c25873650ae3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DH18OFB',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119033416',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'CORSA HATCHBACK',
'odometer': 29595,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34774,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ee1dfcf1-a9a8-4bd2-a077-aa43d39bed25_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37526,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/47f53666-6df4-4f81-bf39-bf12e8c925e2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36035,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/754a9a80-b12c-4583-b531-b0a1fdaaa320_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32596,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/ebe5b59e-e5c5-48e9-98e2-75808094a215_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53744,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/15fd8f3a-1aba-477a-886a-b2e336e2ea0f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39229,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/6f2711f7-916e-4a1c-8d13-424209eeb197_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42453,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/36e9de0f-bba6-4ea3-b419-07deb97abb10_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728a1478-bb25-5a4f-8c98-c25873650ae3/728a1478-bb25-5a4f-8c98-c25873650ae3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30603,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DH18OFB/2026-01-27/image/1b15dac7-b703-4802-ac18-bb854802f767_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-19',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL CORSA HATCHBACK 1.4 SE 5dr',
'transmission': 'manual',
'trim': '1.4 SE 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033416%27 HTTP/1.1" 200 None
2026-01-28 19:02:45 [astonbarclay.gb] INFO: Saving data for 119033416: {'created_time': 1769626965.340687, 'last_price_update_time': 1769626965.340697, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119033416') HTTP/1.1" 204 0
2026-01-28 19:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319195d790>
2026-01-28 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Fbf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902acb10>
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190531dd0>
2026-01-28 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190393b50>
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25HYH%252F2026-01-28%252Fimage%252Fe8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75
2026-01-28 19:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39e231f7-5c21-5f61-a92f-7d6800a2cf75, skipping ID generation
2026-01-28 19:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with scrape type 1
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 39e231f7-5c21-5f61-a92f-7d6800a2cf75 from tracking dictionaries
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39e231f7-5c21-5f61-a92f-7d6800a2cf75 sending to next pipeline
2026-01-28 19:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39e231f7-5c21-5f61-a92f-7d6800a2cf75, identifier: 118917302
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191647390>
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM17VCZ%252F2026-01-28%252Fimage%252F87ba9423-143f-4732-8390-69a360e48734_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41b408f9-8256-575d-90bb-2803e6a70eb0
2026-01-28 19:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41b408f9-8256-575d-90bb-2803e6a70eb0, skipping ID generation
2026-01-28 19:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b408f9-8256-575d-90bb-2803e6a70eb0 with scrape type 1
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 41b408f9-8256-575d-90bb-2803e6a70eb0 from tracking dictionaries
2026-01-28 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41b408f9-8256-575d-90bb-2803e6a70eb0 sending to next pipeline
2026-01-28 19:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 41b408f9-8256-575d-90bb-2803e6a70eb0, identifier: 119044738
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190527a50>
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021595?view=catalogue)
2026-01-28 19:02:48 [astonbarclay.gb] INFO: Found listing with ID: 118589485
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118589485%27 HTTP/1.1" 200 None
2026-01-28 19:02:48 [astonbarclay.gb] INFO: Scrape type for 118589485: 0
2026-01-28 19:02:48 [astonbarclay.gb] INFO: Found listing with ID: 118735864
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735864%27 HTTP/1.1" 200 None
2026-01-28 19:02:48 [astonbarclay.gb] INFO: Scrape type for 118735864: 1
2026-01-28 19:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with identifier: 118917302
2026-01-28 19:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with identifier: 118917302
2026-01-28 19:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 39e231f7-5c21-5f61-a92f-7d6800a2cf75 with identifier: 118917302 to the API
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '39e231f7-5c21-5f61-a92f-7d6800a2cf75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LM25HYH',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118917302',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 1567,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41916,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/30770bca-e796-4e0f-a1ee-91c0d7417eb4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42210,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/35150ab9-3621-4c67-af72-451e46a88ffe_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39267,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/b89b610a-6d7d-4807-ad58-7159f5db136b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42569,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/2f660026-9ee7-4a17-b970-a305a3f6cfcc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45332,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/d6d30b6e-0716-4ab4-93fa-aacff247149c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38011,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/6c11739c-e255-4e75-a4fa-dbd1ee6cf0cf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42849,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/4f9e2d4f-348c-4c09-a5fe-d2db6cd9c9c9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58243,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/bafbbf00-bf65-486e-b4c3-6ac8d53131f7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44865,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/09824419-4a88-43ce-a652-cc2d0a4ce09c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39e231f7-5c21-5f61-a92f-7d6800a2cf75/39e231f7-5c21-5f61-a92f-7d6800a2cf75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46310,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM25HYH/2026-01-28/image/e8fc65ad-6189-42fa-a051-9ccf23fdaf21_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-31',
'seller_name': 'Hedin Automotive',
'title': 'NISSAN JUKE HATCHBACK 1.6 Hybrid Tekna 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 Hybrid Tekna 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118917302%27 HTTP/1.1" 200 None
2026-01-28 19:02:48 [astonbarclay.gb] INFO: Saving data for 118917302: {'created_time': 1769626968.700669, 'last_price_update_time': 1769626968.700679, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118917302') HTTP/1.1" 204 0
2026-01-28 19:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 41b408f9-8256-575d-90bb-2803e6a70eb0 with identifier: 119044738
2026-01-28 19:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 41b408f9-8256-575d-90bb-2803e6a70eb0 with identifier: 119044738
2026-01-28 19:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 41b408f9-8256-575d-90bb-2803e6a70eb0 with identifier: 119044738 to the API
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '41b408f9-8256-575d-90bb-2803e6a70eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LM17VCZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119044738',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'PEUGEOT',
'model': '108 HATCHBACK',
'odometer': 5623,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29538,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b4fdbe9a-d214-423f-9a8e-2eaeb6068b06_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29793,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/b19479f8-e892-4efb-8a54-2df7f59f0fec_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37743,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cff783bb-732f-4473-a2ab-79484676ac33_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31071,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/cb933f5d-a38b-4bca-b5c0-c66bfeb7c6cf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44222,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/5d21e042-d4ad-41ff-adb2-e4638e570600_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45804,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/3d507191-6bd7-4a6b-a368-200b7e30e07f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52164,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/329e51d5-b963-43a5-873d-650bdb03eff4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38613,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/f7a7fb64-8f34-4e3a-a47d-9ecc6d3e182a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b408f9-8256-575d-90bb-2803e6a70eb0/41b408f9-8256-575d-90bb-2803e6a70eb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40360,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LM17VCZ/2026-01-28/image/87ba9423-143f-4732-8390-69a360e48734_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-15',
'seller_name': 'UKCGR - Premium',
'title': 'PEUGEOT 108 HATCHBACK 1.2 PureTech GT Line 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech GT Line 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119044738%27 HTTP/1.1" 200 None
2026-01-28 19:02:49 [astonbarclay.gb] INFO: Saving data for 119044738: {'created_time': 1769626969.059848, 'last_price_update_time': 1769626969.05986, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119044738') HTTP/1.1" 204 0
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190538f10>
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252Ffea457e7-b37d-465c-8076-c57322871121_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374ea90>
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fdc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119057133?view=catalogue)
2026-01-28 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374ff90>
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fd65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183670390>
2026-01-28 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a1a7d0>
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252Fcf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118535894
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118535894%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118535894: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118594000
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118594000%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118594000: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118535803
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118535803%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118535803: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118537231
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118537231%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118537231: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118977727
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118977727%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118977727: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118392424
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118392424%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118392424: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118406095
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118406095%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118406095: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118404239
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118404239%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118404239: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118424535
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118424535%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118424535: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118423390
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118423390%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118423390: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118343791
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118343791%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118343791: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118432609
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118432609%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118432609: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118434195
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118434195%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118434195: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118437571
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118437571%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118437571: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118441697
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118441697%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118441697: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118463036
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118463036%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118463036: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118413595
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118413595%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118413595: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118467585
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118467585%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118467585: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118491282
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118491282%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118491282: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118494390
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118494390%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118494390: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 119003916
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119003916%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 119003916: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118657550
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118657550%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118657550: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118612395
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118612395%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118612395: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118639522
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118639522%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118639522: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118495062
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118495062%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118495062: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118654769
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654769%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118654769: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118740788
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118740788%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118740788: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118738368
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118738368%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118738368: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118715735
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118715735%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118715735: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118680177
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118680177%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118680177: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 119057593
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119057593%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 119057593: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 118711833
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118711833%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 118711833: 0
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 119067642
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119067642%27 HTTP/1.1" 200 None
2026-01-28 19:02:50 [astonbarclay.gb] INFO: Scrape type for 119067642: 1
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900bdb90>
2026-01-28 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Ffe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318373b810>
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183675f50>
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119020038?view=catalogue)
2026-01-28 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919770d0>
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319013f810>
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN18OAC%252F2026-01-28%252Fimage%252F723050db-ea28-4828-838b-c5f610deed46_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06ef0e77-ef53-5c98-83db-4613fc882c0c
2026-01-28 19:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06ef0e77-ef53-5c98-83db-4613fc882c0c, skipping ID generation
2026-01-28 19:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ef0e77-ef53-5c98-83db-4613fc882c0c with scrape type 1
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06ef0e77-ef53-5c98-83db-4613fc882c0c from tracking dictionaries
2026-01-28 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06ef0e77-ef53-5c98-83db-4613fc882c0c sending to next pipeline
2026-01-28 19:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 06ef0e77-ef53-5c98-83db-4613fc882c0c, identifier: 119021595
2026-01-28 19:02:52 [astonbarclay.gb] INFO: Found listing with ID: 118166957
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118166957%27 HTTP/1.1" 200 None
2026-01-28 19:02:52 [astonbarclay.gb] INFO: Scrape type for 118166957: 2
2026-01-28 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 06ef0e77-ef53-5c98-83db-4613fc882c0c with identifier: 119021595
2026-01-28 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 06ef0e77-ef53-5c98-83db-4613fc882c0c with identifier: 119021595
2026-01-28 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156596 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156596
2026-01-28 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 06ef0e77-ef53-5c98-83db-4613fc882c0c spider: astonbarclay.gb
2026-01-28 19:02:52 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 06ef0e77-ef53-5c98-83db-4613fc882c0c due to rule: high_mileage_for_country.json, error: 156596 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156596
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '06ef0e77-ef53-5c98-83db-4613fc882c0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GN18OAC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119021595',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT DIESEL SW',
'odometer': 97305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31722,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bcf8f3ac-f891-40cf-ad67-7f40859a567d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31694,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/c0906f6c-c308-437c-8b8e-b3a3ae610bd0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33286,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/3c2f628b-10bf-4e13-a1a5-9f289a124b58_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34822,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/4ef14733-9886-4b5b-9ebd-d2d36b965429_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47786,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/a711564d-df25-4f61-9edd-a4662ebcb7e5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48754,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/723050db-ea28-4828-838b-c5f610deed46_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50580,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/e76bb32a-b346-44ae-a340-f1fd3a24181d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59253,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/bf7e47c5-d656-4550-b2b7-ff62c7843869_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46673,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/fea457e7-b37d-465c-8076-c57322871121_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ef0e77-ef53-5c98-83db-4613fc882c0c/06ef0e77-ef53-5c98-83db-4613fc882c0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47927,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GN18OAC/2026-01-28/image/39b09a8e-18f2-4cb1-8716-1dc653cc1baf_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-25',
'seller_name': 'UKCGR - Premium',
'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 TD4 180 HSE 5dr Auto',
'vin': None,
'year': 2018}
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119021595%27 HTTP/1.1" 200 None
2026-01-28 19:02:52 [astonbarclay.gb] INFO: Saving data for 119021595: {'created_time': 1769626972.716117, 'last_price_update_time': 1769626972.716127, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119021595') HTTP/1.1" 204 0
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901ba750>
2026-01-28 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF19FSG%252F2026-01-28%252Fimage%252F3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efe242a8-6e66-56dc-bee1-5c22aec06a39
2026-01-28 19:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe242a8-6e66-56dc-bee1-5c22aec06a39, skipping ID generation
2026-01-28 19:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe242a8-6e66-56dc-bee1-5c22aec06a39 with scrape type 1
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item efe242a8-6e66-56dc-bee1-5c22aec06a39 from tracking dictionaries
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efe242a8-6e66-56dc-bee1-5c22aec06a39 sending to next pipeline
2026-01-28 19:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: efe242a8-6e66-56dc-bee1-5c22aec06a39, identifier: 119057133
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190360550>
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252Fe9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037033?view=catalogue)
2026-01-28 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: efe242a8-6e66-56dc-bee1-5c22aec06a39 with identifier: 119057133
2026-01-28 19:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: efe242a8-6e66-56dc-bee1-5c22aec06a39 with identifier: 119057133
2026-01-28 19:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: efe242a8-6e66-56dc-bee1-5c22aec06a39 with identifier: 119057133 to the API
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'efe242a8-6e66-56dc-bee1-5c22aec06a39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BF19FSG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119057133',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'ASTRA HATCHBACK',
'odometer': 19917,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36003,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/ef5f63e1-d340-46d4-9e9f-fb66c98f1809_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34183,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/349228b3-7c4a-440d-84b3-774d38a14195_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38322,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/040255bd-b466-47c2-b822-f665fa7ac484_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36276,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/50184281-2565-492b-affd-6661d32f96bc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38518,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/9576a688-764b-4af4-9ec6-8e6f062701fd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44615,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/dc646b71-506d-492a-8c2c-41a6c3896839_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33492,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/cf39c077-dd5a-4fff-8de4-4041b457cdcd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39823,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/72e166f8-a055-4a44-8a6c-50302952068a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe242a8-6e66-56dc-bee1-5c22aec06a39/efe242a8-6e66-56dc-bee1-5c22aec06a39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35294,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/BF19FSG/2026-01-28/image/3ff18199-5b51-4a27-8074-592315d267a4_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-01',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL ASTRA HATCHBACK 1.4T 16V 150 Elite Nav 5dr Auto',
'transmission': 'automatic',
'trim': '1.4T 16V 150 Elite Nav 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119057133%27 HTTP/1.1" 200 None
2026-01-28 19:02:53 [astonbarclay.gb] INFO: Saving data for 119057133: {'created_time': 1769626973.818091, 'last_price_update_time': 1769626973.818101, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119057133') HTTP/1.1" 204 0
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b1350>
2026-01-28 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Faf3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:54 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2026-01-28 19:02:54 [astonbarclay.gb] INFO: Scrape type for 115302250: 2
2026-01-28 19:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118519179?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903b4350>
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183611490>
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAY69LXM%252F2026-01-27%252Fimage%252F749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0
2026-01-28 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0, skipping ID generation
2026-01-28 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with scrape type 1
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 from tracking dictionaries
2026-01-28 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 sending to next pipeline
2026-01-28 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0, identifier: 119020038
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190321790>
2026-01-28 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Ffd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042202?view=catalogue)
2026-01-28 19:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with identifier: 119020038
2026-01-28 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with identifier: 119020038
2026-01-28 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2ddf1b30-a602-553b-b81e-2c4726cd2ae0 with identifier: 119020038 to the API
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2ddf1b30-a602-553b-b81e-2c4726cd2ae0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AY69LXM',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119020038',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS DIESEL HATCHBACK',
'odometer': 36969,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30331,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/889f22cb-5ca1-4acb-b172-6352f9e6e0cc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30142,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e1b58b8d-32b0-4f14-b3bc-b2333805ed43_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31585,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/3ce745ed-e651-4203-8035-5d3c2ffa5804_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28219,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/02712c12-34d9-4255-a855-05785e1263e3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40628,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/9762e62b-0227-4ece-8997-dd141b3a4339_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53249,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/64dc74b2-d814-4462-b9fc-3b45612524b9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54555,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/d65967d8-1470-4e96-9528-4a92ddcd80a8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38220,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e7162956-ed88-4416-8d49-e05a6b5082b1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43086,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/e9196b84-a3e5-407c-942d-75624c8876ac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ddf1b30-a602-553b-b81e-2c4726cd2ae0/2ddf1b30-a602-553b-b81e-2c4726cd2ae0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51928,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AY69LXM/2026-01-27/image/749c28aa-1c7d-4df8-813a-236754386869_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-27',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A200d AMG Line Executive 5dr '
'Auto',
'transmission': 'automatic',
'trim': 'A200d AMG Line Executive 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119020038%27 HTTP/1.1" 200 None
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Saving data for 119020038: {'created_time': 1769626975.442627, 'last_price_update_time': 1769626975.442637, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119020038') HTTP/1.1" 204 0
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118694625, 'registration': 'DN73TJU', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Plug-in Hybrid GS 5dr Auto', 'mileage': 35655, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/25 - 32K', 'remarks': '**292** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60ddde0c-52fe-4d12-a843-7f1c06e64ca9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118694625, 'registration': 'DN73TJU', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Plug-in Hybrid GS 5dr Auto', 'mileage': 35655, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/25 - 32K', 'remarks': '**292** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60ddde0c-52fe-4d12-a843-7f1c06e64ca9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f360d8-6749-52f5-8cf7-847c84869f75 with identifier: 118694625
2026-01-28 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f360d8-6749-52f5-8cf7-847c84869f75 with scrape type 1
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fb030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118741136, 'registration': 'YM72JGO', 'account': 'KIN032', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line [X Pack] 5dr', 'mileage': 25954, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-01-18', 'fuel': 'Petrol', 'motExpiry': '2027-01-17', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24- 13K,', 'remarks': '**241**VOSA STATES 25K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f43739d2-a3d1-4e39-a335-6c5d9523712d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118741136, 'registration': 'YM72JGO', 'account': 'KIN032', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line [X Pack] 5dr', 'mileage': 25954, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-01-18', 'fuel': 'Petrol', 'motExpiry': '2027-01-17', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24- 13K,', 'remarks': '**241**VOSA STATES 25K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f43739d2-a3d1-4e39-a335-6c5d9523712d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with identifier: 118741136
2026-01-28 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with scrape type 1
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 118058161
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118058161%27 HTTP/1.1" 200 None
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Scrape type for 118058161: 0
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 118164228
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118164228%27 HTTP/1.1" 200 None
2026-01-28 19:02:55 [astonbarclay.gb] INFO: Scrape type for 118164228: 2
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183675fd0>
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22KMO%252F2026-01-28%252Fimage%252F7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc69414-269e-5114-b87c-ba232f407e11
2026-01-28 19:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc69414-269e-5114-b87c-ba232f407e11, skipping ID generation
2026-01-28 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc69414-269e-5114-b87c-ba232f407e11 with scrape type 1
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4cc69414-269e-5114-b87c-ba232f407e11 from tracking dictionaries
2026-01-28 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc69414-269e-5114-b87c-ba232f407e11 sending to next pipeline
2026-01-28 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4cc69414-269e-5114-b87c-ba232f407e11, identifier: 119037033
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31918694d0>
2026-01-28 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252F23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118735717, 'registration': 'ML24FTU', 'account': 'KIN032', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 25959, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-04-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 12K', 'remarks': '**219** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/df419b15-d8ee-49db-98a6-8eacf958749c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118735717, 'registration': 'ML24FTU', 'account': 'KIN032', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 25959, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-04-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 12K', 'remarks': '**219** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/df419b15-d8ee-49db-98a6-8eacf958749c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b206a489-0323-53f7-a3f0-1aa0ae9da13e with identifier: 118735717
2026-01-28 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b206a489-0323-53f7-a3f0-1aa0ae9da13e with scrape type 1
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118317404, 'registration': 'HV72UDP', 'account': 'DAY005', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '250kW eDrive40 M Sport 83.9kWh 5dr Auto', 'mileage': 60931, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-31', 'fuel': 'Electric', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1448** VOSA STATES 59K SPARE KEY', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8fc82ba-9ba6-4f39-9efd-46ee6c5f7293.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118317404, 'registration': 'HV72UDP', 'account': 'DAY005', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '250kW eDrive40 M Sport 83.9kWh 5dr Auto', 'mileage': 60931, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-31', 'fuel': 'Electric', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1448** VOSA STATES 59K SPARE KEY', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8fc82ba-9ba6-4f39-9efd-46ee6c5f7293.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef489e5-275f-5a12-bf10-beae35721514 with identifier: 118317404
2026-01-28 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef489e5-275f-5a12-bf10-beae35721514 with scrape type 1
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F682867c9-3725-415d-b728-59e532d4f087_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F8415d725-faac-4564-912d-67b5563874cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fe79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4cc69414-269e-5114-b87c-ba232f407e11 with identifier: 119037033
2026-01-28 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4cc69414-269e-5114-b87c-ba232f407e11 with identifier: 119037033
2026-01-28 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4cc69414-269e-5114-b87c-ba232f407e11 with identifier: 119037033 to the API
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4cc69414-269e-5114-b87c-ba232f407e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EU22KMO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119037033',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FIAT',
'model': '500 HATCHBACK',
'odometer': 16904,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32328,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/05c9aa29-11d4-4a80-96aa-4b8282a526b9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30113,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/bc2a9295-ba22-420f-8920-fed9f921bd0b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32042,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/c880dfaf-50a8-47d1-a40e-76d19651c32c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28602,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/d4f6d04f-16a8-4cd9-a78f-00254a8d799d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46643,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/f0153ed0-94ae-4418-9b8a-8474e1c5bdac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44507,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89dea83a-aadb-417d-abec-f2b4d230d623_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46842,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/89e96296-ef65-48a5-8844-484303abec0d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41030,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/38018611-7021-4330-962e-853b23dd856e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc69414-269e-5114-b87c-ba232f407e11/4cc69414-269e-5114-b87c-ba232f407e11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45905,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EU22KMO/2026-01-28/image/7aa60b1f-59c9-489d-8d56-b606c0ff55fa_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-27',
'seller_name': 'UKCGR - Premium',
'title': 'FIAT 500 HATCHBACK 1.0 Mild Hybrid Dolcevita [Part Leather] 3dr',
'transmission': 'manual',
'trim': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr',
'vin': None,
'year': 2022}
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037033%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Saving data for 119037033: {'created_time': 1769626976.625755, 'last_price_update_time': 1769626976.625766, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119037033') HTTP/1.1" 204 0
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118953753, 'registration': 'LB71ZSY', 'account': 'ALL002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 50711, 'mileageWarranty': True, 'type': 'car', 'saleId': 18363, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-05T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-15', 'fuel': 'Electric', 'motExpiry': '2026-02-14', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d1d28f47-91ca-4b47-8d40-407ee4f4bc19.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118953753, 'registration': 'LB71ZSY', 'account': 'ALL002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 50711, 'mileageWarranty': True, 'type': 'car', 'saleId': 18363, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-05T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-15', 'fuel': 'Electric', 'motExpiry': '2026-02-14', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d1d28f47-91ca-4b47-8d40-407ee4f4bc19.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c50b691c-fbdd-548b-9eab-16416036e648 with identifier: 118953753
2026-01-28 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50b691c-fbdd-548b-9eab-16416036e648 with scrape type 1
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118687613, 'registration': 'VK72GKZ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 21017, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-12-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/24- 14K,', 'remarks': '**282**VOSA STATES 20K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2616f4ca-9d6b-4bde-8016-768189f8e450.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118687613, 'registration': 'VK72GKZ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 21017, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-12-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/24- 14K,', 'remarks': '**282**VOSA STATES 20K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2616f4ca-9d6b-4bde-8016-768189f8e450.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb with identifier: 118687613
2026-01-28 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb with scrape type 1
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Fe2277859-1503-44f6-a216-2b0fed728630_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118519179, 'registration': 'FL68PHV', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Sport Nav 5dr', 'mileage': 52598, 'mileageWarranty': True, 'type': 'car', 'saleId': 18363, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-05T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL68PHV/2026-01-21/image/8eca38ba-4556-46b7-bd6a-23006333244b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/e60f84fe-e1b0-4e0e-8ae5-0fb5e5f5db66_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/cd53d3b5-b241-455c-a0ba-dd8be61781c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/903a1380-15ec-44c7-8f6b-9acd54c6530b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/e0cdb62a-e7ae-4593-b2c6-bfb3de3e3b24_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/9fd71e5f-77b9-4710-9655-15e7fc0b7514_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/64360e37-822e-4743-a5d3-f59619408768_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/cde31b3e-f191-4b19-8621-23f96b021d85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/fe0c9cc7-b553-42c0-88cc-9da6a71d0181_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19-11k, 06/20-17k, 09/21-24k, 09/22-31k, 09/23-44k, 10/24-49k,', 'remarks': 'SPARE KEY, vosa states 24k, 32k, 44k, 49k,', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e23b515-1b37-49ac-b31f-3bb6f49895c9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118519179, 'registration': 'FL68PHV', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Sport Nav 5dr', 'mileage': 52598, 'mileageWarranty': True, 'type': 'car', 'saleId': 18363, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-02-05T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL68PHV/2026-01-21/image/8eca38ba-4556-46b7-bd6a-23006333244b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/e60f84fe-e1b0-4e0e-8ae5-0fb5e5f5db66_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/cd53d3b5-b241-455c-a0ba-dd8be61781c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/903a1380-15ec-44c7-8f6b-9acd54c6530b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/e0cdb62a-e7ae-4593-b2c6-bfb3de3e3b24_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/9fd71e5f-77b9-4710-9655-15e7fc0b7514_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/64360e37-822e-4743-a5d3-f59619408768_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/cde31b3e-f191-4b19-8621-23f96b021d85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL68PHV/2026-01-21/image/fe0c9cc7-b553-42c0-88cc-9da6a71d0181_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19-11k, 06/20-17k, 09/21-24k, 09/22-31k, 09/23-44k, 10/24-49k,', 'remarks': 'SPARE KEY, vosa states 24k, 32k, 44k, 49k,', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e23b515-1b37-49ac-b31f-3bb6f49895c9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a64f18-48a7-5175-b365-cff02f93f7ea with identifier: 118519179
2026-01-28 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a64f18-48a7-5175-b365-cff02f93f7ea with scrape type 2
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a64f18-48a7-5175-b365-cff02f93f7ea with scrape type 2
2026-01-28 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a3a64f18-48a7-5175-b365-cff02f93f7ea, identifier: 118519179
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119028633?view=catalogue)
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Found listing with ID: 118715535
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118715535%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [astonbarclay.gb] INFO: Scrape type for 118715535: 1
2026-01-28 19:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fc5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a3a64f18-48a7-5175-b365-cff02f93f7ea with identifier: 118519179
2026-01-28 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a3a64f18-48a7-5175-b365-cff02f93f7ea with identifier: 118519179
2026-01-28 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a3a64f18-48a7-5175-b365-cff02f93f7ea with identifier: 118519179 to the API
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a3a64f18-48a7-5175-b365-cff02f93f7ea%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a3a64f18-48a7-5175-b365-cff02f93f7ea: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:02:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118519179?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-05T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a3a64f18-48a7-5175-b365-cff02f93f7ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FL68PHV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118519179',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VAUXHALL',
'model': 'GRANDLAND X HATCHBACK',
'odometer': 52598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-30',
'seller_name': 'Stellantis Financial Services UK',
'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo Sport Nav 5dr',
'transmission': 'manual',
'trim': '1.2 Turbo Sport Nav 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118519179%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [astonbarclay.gb] INFO: Saving data for 118519179: {'auction_closing_time': 1770285600.0, 'created_time': 1768244620.948437, 'last_price_update_time': 1769626977.114234}
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118519179') HTTP/1.1" 204 0
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318367d890>
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252F427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028e490>
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA24WBZ%252F2026-01-28%252Fimage%252Fcfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1
2026-01-28 19:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1, skipping ID generation
2026-01-28 19:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with scrape type 1
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 from tracking dictionaries
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 sending to next pipeline
2026-01-28 19:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1, identifier: 119042202
2026-01-28 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119032588?view=catalogue)
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fd45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with identifier: 119042202
2026-01-28 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with identifier: 119042202
2026-01-28 19:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9eab9d36-bcd3-5936-85aa-ea06e802f7e1 with identifier: 119042202 to the API
2026-01-28 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9eab9d36-bcd3-5936-85aa-ea06e802f7e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EA24WBZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119042202',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'HYUNDAI',
'model': 'I10 HATCHBACK',
'odometer': 4487,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28821,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/0248ff92-8d5d-43ff-be97-fdc60c25709a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29453,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/4683671f-c2b8-4b8c-bc2c-d1ea601cf152_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28172,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/9b9644fa-d3fa-4c5c-b15f-be39b6de5da5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30413,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/a48cc38c-7aa7-44bf-a3bd-beab71e7eb10_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30411,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/cfc5dc04-92ac-45af-aaa1-edfa7530efbb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38506,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/23b7270e-d91e-4b27-84ea-f804e57a6dc0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35268,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fd41ca13-581e-4192-b96c-3a59c872732a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28559,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/1a8a3857-c054-4205-b82a-9ce5a250b893_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eab9d36-bcd3-5936-85aa-ea06e802f7e1/9eab9d36-bcd3-5936-85aa-ea06e802f7e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34904,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EA24WBZ/2026-01-28/image/fe8fe773-b202-48c1-a68d-a67a787169b0_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-18',
'seller_name': 'UKCGR - Premium',
'title': 'HYUNDAI I10 HATCHBACK 1.0 Advance 5dr Auto',
'transmission': 'automatic',
'trim': '1.0 Advance 5dr Auto',
'vin': None,
'year': 2024}
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042202%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Saving data for 119042202: {'created_time': 1769626978.211724, 'last_price_update_time': 1769626978.211734, 'auction_closing_time': 1770199200.0}
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119042202') HTTP/1.1" 204 0
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Found listing with ID: 116612235
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116612235%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Scrape type for 116612235: 0
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Found listing with ID: 118729005
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118729005%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Scrape type for 118729005: 0
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Found listing with ID: 118890106
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118890106%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Scrape type for 118890106: 1
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fbaf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319047cd10>
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fcac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190626890>
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118750135, 'registration': 'GU72VHV', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 28792, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-12', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 - 7K, 09/24 - 16K,', 'remarks': '**381** VOSA STATES 25K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9fa348f6-0693-4ff5-bd7a-9d8a04fae257.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118750135, 'registration': 'GU72VHV', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 28792, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-12', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 - 7K, 09/24 - 16K,', 'remarks': '**381** VOSA STATES 25K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9fa348f6-0693-4ff5-bd7a-9d8a04fae257.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 with identifier: 118750135
2026-01-28 19:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 with scrape type 1
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fbcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Febbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191c24e90>
2026-01-28 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSE19DFJ%252F2026-01-28%252Fimage%252Fc60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97d9b41e-9da4-588a-8871-bf3083faccff
2026-01-28 19:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97d9b41e-9da4-588a-8871-bf3083faccff, skipping ID generation
2026-01-28 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d9b41e-9da4-588a-8871-bf3083faccff with scrape type 1
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97d9b41e-9da4-588a-8871-bf3083faccff from tracking dictionaries
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97d9b41e-9da4-588a-8871-bf3083faccff sending to next pipeline
2026-01-28 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 97d9b41e-9da4-588a-8871-bf3083faccff, identifier: 119028633
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190303cd0>
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fb8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904ac210>
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fe758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600 saved to cache
2026-01-28 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118787750
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118787750%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118787750: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118649750
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118649750%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118649750: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118619288
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118619288%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118619288: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118946888
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118946888%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118946888: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118404563
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118404563%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118404563: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118184143
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118184143%27 HTTP/1.1" 200 None
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Scrape type for 118184143: 0
2026-01-28 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 118157000
2026-01-28 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118157000%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118157000: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117156014
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117156014%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117156014: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117485854
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117485854%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117485854: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118272940
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118272940%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118272940: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118284477
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118284477%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118284477: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118339135
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118339135%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118339135: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118340134
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118340134%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118340134: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118347200
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118347200%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118347200: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118347247
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118347247%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118347247: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118345061
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118345061%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118345061: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118365834
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118365834%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118365834: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118650428
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118650428%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118650428: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118115896
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118115896%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118115896: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118496748
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118496748%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118496748: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118459228
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118459228%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118459228: 0
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 118159423
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118159423%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [astonbarclay.gb] INFO: Scrape type for 118159423: 2
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fb3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 97d9b41e-9da4-588a-8871-bf3083faccff with identifier: 119028633
2026-01-28 19:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 97d9b41e-9da4-588a-8871-bf3083faccff with identifier: 119028633
2026-01-28 19:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 97d9b41e-9da4-588a-8871-bf3083faccff with identifier: 119028633 to the API
2026-01-28 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 207,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '97d9b41e-9da4-588a-8871-bf3083faccff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SE19DFJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119028633',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'PORSCHE',
'model': 'CAYENNE ESTATE',
'odometer': 57154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39639,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/ccc6a539-7bde-4e75-9998-342a9e48e2c2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39896,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/e68b2b11-b8a4-421a-9b19-35fe0dc3c58e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34013,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/c60934cc-1b4d-4afb-a39c-19b9ac95e596_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41306,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/805945f9-ec85-4807-a599-70bcd34d5d1d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39074,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/cac958c3-b608-4505-bd31-010c1d8d0738_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53865,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/427de6ad-e1ac-4239-bd78-7b1b5a272573_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39276,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/53140828-57bc-4da8-b249-c2cd9288a24f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36948,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/af3b1fa8-ceb5-4beb-ac1d-b3f727a5a9dc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d9b41e-9da4-588a-8871-bf3083faccff/97d9b41e-9da4-588a-8871-bf3083faccff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33657,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SE19DFJ/2026-01-28/image/8c37e584-2357-4817-960b-4adbd3dfc27f_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seller_name': 'UKCGR - Premium',
'title': 'PORSCHE CAYENNE ESTATE 5dr Tiptronic S',
'transmission': 'automatic',
'trim': '5dr Tiptronic S',
'vin': None,
'year': 2019}
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119028633%27 HTTP/1.1" 200 None
2026-01-28 19:03:01 [astonbarclay.gb] INFO: Saving data for 119028633: {'created_time': 1769626981.748308, 'last_price_update_time': 1769626981.748319, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119028633') HTTP/1.1" 204 0
2026-01-28 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318362e950>
2026-01-28 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY20KJO%252F2026-01-28%252Fimage%252F6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35826001-bb3e-5012-8dbf-d59b7566223a
2026-01-28 19:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35826001-bb3e-5012-8dbf-d59b7566223a, skipping ID generation
2026-01-28 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35826001-bb3e-5012-8dbf-d59b7566223a with scrape type 1
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 35826001-bb3e-5012-8dbf-d59b7566223a from tracking dictionaries
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35826001-bb3e-5012-8dbf-d59b7566223a sending to next pipeline
2026-01-28 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35826001-bb3e-5012-8dbf-d59b7566223a, identifier: 119032588
2026-01-28 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35826001-bb3e-5012-8dbf-d59b7566223a with identifier: 119032588
2026-01-28 19:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35826001-bb3e-5012-8dbf-d59b7566223a with identifier: 119032588
2026-01-28 19:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35826001-bb3e-5012-8dbf-d59b7566223a with identifier: 119032588 to the API
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '35826001-bb3e-5012-8dbf-d59b7566223a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EY20KJO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119032588',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'MICRA HATCHBACK',
'odometer': 10323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29423,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/13b28d28-2fbf-49f8-88a2-7b7066e16d2b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31908,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/fa22b721-09b7-4aec-b6ad-f23bbe0c8519_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30519,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/aa6af4ca-f13e-4271-a6e1-76cabb6425f1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30114,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/61b8aba3-4436-4ce5-ba38-eb84df0251b3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55652,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/81d70886-2047-4bf9-a51a-d7ede698040f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68839,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/c7757afe-d049-4b7b-ae1c-6bde18a9619d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60304,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/29a032c4-f12c-4efc-a7b3-3b695c0c7a78_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55997,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/082f3d87-61d4-468e-97bb-915b0d7d10d4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48201,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/6c606a96-9f4e-4c88-a686-d0f79ef3635d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35826001-bb3e-5012-8dbf-d59b7566223a/35826001-bb3e-5012-8dbf-d59b7566223a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46048,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EY20KJO/2026-01-28/image/109d8a95-ce7f-4d41-805b-fb65edf347ea_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-06',
'seller_name': 'UKCGR - Premium',
'title': 'NISSAN MICRA HATCHBACK 1.0 IG-T 100 Acenta 5dr Xtronic',
'transmission': 'automatic',
'trim': '1.0 IG-T 100 Acenta 5dr Xtronic',
'vin': None,
'year': 2020}
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119032588%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Saving data for 119032588: {'created_time': 1769626982.677846, 'last_price_update_time': 1769626982.677857, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119032588') HTTP/1.1" 204 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118741529
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118741529%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118741529: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118472067
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118472067%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118472067: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118758069
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118758069%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118758069: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118792801
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118792801%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118792801: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118795272
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118795272%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118795272: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118379721
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118379721%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118379721: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118598229
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118598229%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118598229: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118668880
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118668880%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118668880: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118861674
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118861674%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118861674: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118273537
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118273537%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118273537: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118705493
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118705493%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118705493: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118137298
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118137298%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118137298: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118503986
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118503986%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118503986: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118913743
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118913743%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118913743: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118691597
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118691597%27 HTTP/1.1" 200 None
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Scrape type for 118691597: 0
2026-01-28 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 118790219
2026-01-28 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118790219%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118790219: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118615889
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118615889%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118615889: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118183548
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118183548%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118183548: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118378030
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118378030%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118378030: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118139824
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118139824%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118139824: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118533973
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118533973%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118533973: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118231234
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118231234%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118231234: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118156459
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118156459%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118156459: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118661783
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118661783%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118661783: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118635130
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118635130%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118635130: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118185676
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118185676%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118185676: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118663217
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118663217%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118663217: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118870752
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118870752%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118870752: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118879568
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118879568%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118879568: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 116412555: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118139976
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118139976%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118139976: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118659789
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118659789%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118659789: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 117425960
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425960%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 117425960: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118684570
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118684570%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118684570: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 117416921
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 117416921: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118661096
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118661096%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118661096: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118759015
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118759015%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118759015: 0
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118000107
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118000107%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Scrape type for 118000107: 2
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F7343591a-105b-400f-8811-8803be7149ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319022ced0>
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905265d0>
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fb030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 118263462
2026-01-28 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118263462%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Scrape type for 118263462: 2
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fb3617715-8175-4627-8bc2-932847c92d67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319051f290>
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F682867c9-3725-415d-b728-59e532d4f087_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190488a10>
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318367f550>
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Fe2277859-1503-44f6-a216-2b0fed728630_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fb6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Fde39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 118052697
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118052697%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Scrape type for 118052697: 0
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 118696579
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118696579%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Scrape type for 118696579: 0
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 119022924
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022924%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Scrape type for 119022924: 0
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 118094755
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118094755%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [astonbarclay.gb] INFO: Scrape type for 118094755: 2
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Fac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Ffec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Fc9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118166957?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119033241?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119067642?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119040119?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900fac50>
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900ed090>
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191d30e90>
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318362fb10>
2026-01-28 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:06 [scrapy.extensions.logstats] INFO: Crawled 158 pages (at 27 pages/min), scraped 64 items (at 20 items/min)
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 119096859
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119096859%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Scrape type for 119096859: 1
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Fc5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fc2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F02f2c698-add8-423d-b384-813724e00696_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Fa263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900f9e50>
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Febbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 119062862
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119062862%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Scrape type for 119062862: 1
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fde8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fbf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119033233, 'registration': 'EK71XNU', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A180 AMG Line Executive Edition 5dr Auto', 'mileage': 38169, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-14', 'fuel': 'Petrol', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3685768c-9362-441f-a7e3-2a738c4f5d4a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119033233, 'registration': 'EK71XNU', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A180 AMG Line Executive Edition 5dr Auto', 'mileage': 38169, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-14', 'fuel': 'Petrol', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3685768c-9362-441f-a7e3-2a738c4f5d4a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b433f74b-c443-5afb-9342-1f0b9b16526a with identifier: 119033233
2026-01-28 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b433f74b-c443-5afb-9342-1f0b9b16526a with scrape type 1
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119042739, 'registration': 'MK18LCZ', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT DIESEL HATCHBACK', 'derivative': '1.5 TDCi Titanium 5dr', 'mileage': 50175, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8705b47-eaac-4942-a6df-6aa94bd31dd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119042739, 'registration': 'MK18LCZ', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT DIESEL HATCHBACK', 'derivative': '1.5 TDCi Titanium 5dr', 'mileage': 50175, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8705b47-eaac-4942-a6df-6aa94bd31dd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4445c656-e70d-5b90-b0fb-af9a7abb8560 with identifier: 119042739
2026-01-28 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4445c656-e70d-5b90-b0fb-af9a7abb8560 with scrape type 1
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118166957, 'registration': 'LD72GHH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW GT Premium 50kWh 5dr Auto', 'mileage': 3149, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD72GHH/2025-12-22/image/0eb8e0ca-b97f-4e30-80f0-b0f8967f059e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/92386a4a-1e3d-4945-bcc2-4a4679248faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/bd37968d-e9f2-490a-8e58-e447b485b8de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/61f50920-0b1f-432d-a7cc-0a3a942a6b6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/414612ed-27c9-43f5-b540-138c7603001e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/014ca532-fdb3-4697-b183-c5f05512c57d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/44b01ab6-1e65-4029-8434-e44771781150_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/2169c4cb-cf6f-45d1-8abd-d89d9e75f1ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/24f43d30-87ae-4d89-816c-d5a74b98ba94_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 2K -', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE - V5 DOCUMENT NUMBER AVAILABLE ON REQUEST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74f5590c-15ed-4b5a-bd0c-68fe39cfe882.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118166957, 'registration': 'LD72GHH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW GT Premium 50kWh 5dr Auto', 'mileage': 3149, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD72GHH/2025-12-22/image/0eb8e0ca-b97f-4e30-80f0-b0f8967f059e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/92386a4a-1e3d-4945-bcc2-4a4679248faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/bd37968d-e9f2-490a-8e58-e447b485b8de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/61f50920-0b1f-432d-a7cc-0a3a942a6b6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/414612ed-27c9-43f5-b540-138c7603001e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/014ca532-fdb3-4697-b183-c5f05512c57d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/44b01ab6-1e65-4029-8434-e44771781150_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/2169c4cb-cf6f-45d1-8abd-d89d9e75f1ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD72GHH/2025-12-22/image/24f43d30-87ae-4d89-816c-d5a74b98ba94_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 2K -', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE - V5 DOCUMENT NUMBER AVAILABLE ON REQUEST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74f5590c-15ed-4b5a-bd0c-68fe39cfe882.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd10f264-66d6-568b-81ef-f83a89f281b7 with identifier: 118166957
2026-01-28 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd10f264-66d6-568b-81ef-f83a89f281b7 with scrape type 2
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd10f264-66d6-568b-81ef-f83a89f281b7 with scrape type 2
2026-01-28 19:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bd10f264-66d6-568b-81ef-f83a89f281b7, identifier: 118166957
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119033241, 'registration': 'WV66RPX', 'account': 'WBA002', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi GT-Line 5dr [AWD]', 'mileage': 80036, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-07', 'fuel': 'Petrol', 'motExpiry': '2027-01-15', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7b7cc97c-511b-4924-926b-4c639ebdeba5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119033241, 'registration': 'WV66RPX', 'account': 'WBA002', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi GT-Line 5dr [AWD]', 'mileage': 80036, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-07', 'fuel': 'Petrol', 'motExpiry': '2027-01-15', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7b7cc97c-511b-4924-926b-4c639ebdeba5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 with identifier: 119033241
2026-01-28 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 with scrape type 1
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1cfeeb73-8be0-5d64-b0fd-14193c96ab93
2026-01-28 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1cfeeb73-8be0-5d64-b0fd-14193c96ab93
2026-01-28 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93, identifier: 119033241
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119067642, 'registration': 'LR70YDS', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI S Line 5dr', 'mileage': 80784, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3de4682d-94a6-4d9c-ab92-5ad2033a57b5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119067642, 'registration': 'LR70YDS', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI S Line 5dr', 'mileage': 80784, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3de4682d-94a6-4d9c-ab92-5ad2033a57b5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d03ab7f-48e4-5dea-b04a-a18ba9690b15 with identifier: 119067642
2026-01-28 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d03ab7f-48e4-5dea-b04a-a18ba9690b15 with scrape type 1
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3d03ab7f-48e4-5dea-b04a-a18ba9690b15
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3d03ab7f-48e4-5dea-b04a-a18ba9690b15
2026-01-28 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3d03ab7f-48e4-5dea-b04a-a18ba9690b15, identifier: 119067642
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119040119, 'registration': 'AX69HDL', 'account': 'WBA002', 'make': 'FORD', 'model': 'GALAXY DIESEL ESTATE', 'derivative': '2.0 EcoBlue Titanium 5dr Auto', 'mileage': 61027, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-02-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119040119, 'registration': 'AX69HDL', 'account': 'WBA002', 'make': 'FORD', 'model': 'GALAXY DIESEL ESTATE', 'derivative': '2.0 EcoBlue Titanium 5dr Auto', 'mileage': 61027, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-02-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c762d1-f3dd-5263-8d13-6e51961dafa2 with identifier: 119040119
2026-01-28 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c762d1-f3dd-5263-8d13-6e51961dafa2 with scrape type 1
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d3c762d1-f3dd-5263-8d13-6e51961dafa2
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d3c762d1-f3dd-5263-8d13-6e51961dafa2
2026-01-28 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d3c762d1-f3dd-5263-8d13-6e51961dafa2, identifier: 119040119
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118698130, 'registration': 'MW72UJH', 'account': 'KIN032', 'make': 'DACIA', 'model': 'SANDERO HATCHBACK', 'derivative': '1.0 TCe Bi-Fuel Comfort 5dr', 'mileage': 23311, 'mileageWarranty': False, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-14', 'fuel': 'Petrol/LPG', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/23 - 6K, 11/24 - 13K, 11/25 - 22K', 'remarks': '**290**VOSA STATES 22K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118698130, 'registration': 'MW72UJH', 'account': 'KIN032', 'make': 'DACIA', 'model': 'SANDERO HATCHBACK', 'derivative': '1.0 TCe Bi-Fuel Comfort 5dr', 'mileage': 23311, 'mileageWarranty': False, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-14', 'fuel': 'Petrol/LPG', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/23 - 6K, 11/24 - 13K, 11/25 - 22K', 'remarks': '**290**VOSA STATES 22K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e015206-9819-59a6-9468-3e3fc8eaab9b with identifier: 118698130
2026-01-28 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e015206-9819-59a6-9468-3e3fc8eaab9b with scrape type 1
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bd10f264-66d6-568b-81ef-f83a89f281b7 with identifier: 118166957
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bd10f264-66d6-568b-81ef-f83a89f281b7 with identifier: 118166957
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw gt premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3149, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118166957', 'expiration_date': '2026-02-09t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw gt premium 50kwh 5dr auto', 'license_plate': 'ld72ghh', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'bd10f264-66d6-568b-81ef-f83a89f281b7', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 5067} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-09t10:00:00z',
'fuel_type': 'electric',
'id': 'bd10f264-66d6-568b-81ef-f83a89f281b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ld72ghh',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118166957',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'peugeot',
'make_model': 'peugeot e-2008 electric estate',
'model': 'e-2008 electric estate',
'odometer': 3149,
'odometer_in_km': 5067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'sanitized_make': 'peugeot',
'seller_name': 'motability operations',
'title': 'peugeot e-2008 electric estate 100kw gt premium 50kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw gt premium 50kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: bd10f264-66d6-568b-81ef-f83a89f281b7 spider: astonbarclay.gb
2026-01-28 19:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bd10f264-66d6-568b-81ef-f83a89f281b7 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw gt premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3149, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118166957', 'expiration_date': '2026-02-09t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw gt premium 50kwh 5dr auto', 'license_plate': 'ld72ghh', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'bd10f264-66d6-568b-81ef-f83a89f281b7', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 5067} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-09t10:00:00z',
'fuel_type': 'electric',
'id': 'bd10f264-66d6-568b-81ef-f83a89f281b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ld72ghh',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118166957',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'peugeot',
'make_model': 'peugeot e-2008 electric estate',
'model': 'e-2008 electric estate',
'odometer': 3149,
'odometer_in_km': 5067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'sanitized_make': 'peugeot',
'seller_name': 'motability operations',
'title': 'peugeot e-2008 electric estate 100kw gt premium 50kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw gt premium 50kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Electric',
'id': 'bd10f264-66d6-568b-81ef-f83a89f281b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LD72GHH',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118166957',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'PEUGEOT',
'model': 'E-2008 ELECTRIC ESTATE',
'odometer': 3149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seller_name': 'Motability Operations',
'title': 'PEUGEOT E-2008 ELECTRIC ESTATE 100kW GT Premium 50kWh 5dr Auto',
'transmission': 'automatic',
'trim': '100kW GT Premium 50kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118166957%27 HTTP/1.1" 200 None
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Saving data for 118166957: {'auction_closing_time': 1770631200.0, 'created_time': 1768331733.379675, 'last_price_update_time': 1769626987.468607}
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118166957') HTTP/1.1" 204 0
2026-01-28 19:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 with identifier: 119033241
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 with identifier: 119033241
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 spider: astonbarclay.gb
2026-01-28 19:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1cfeeb73-8be0-5d64-b0fd-14193c96ab93 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 177,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1cfeeb73-8be0-5d64-b0fd-14193c96ab93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WV66RPX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119033241',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'KIA',
'model': 'SPORTAGE ESTATE',
'odometer': 80036,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-07',
'seller_name': 'UKCGR - Premium',
'title': 'KIA SPORTAGE ESTATE 1.6T GDi GT-Line 5dr [AWD]',
'transmission': 'manual',
'trim': '1.6T GDi GT-Line 5dr [AWD]',
'vin': None,
'year': 2016}
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033241%27 HTTP/1.1" 200 None
2026-01-28 19:03:07 [astonbarclay.gb] INFO: Saving data for 119033241: {'created_time': 1769626987.773165, 'last_price_update_time': 1769626987.773175, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119033241') HTTP/1.1" 204 0
2026-01-28 19:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3d03ab7f-48e4-5dea-b04a-a18ba9690b15 with identifier: 119067642
2026-01-28 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3d03ab7f-48e4-5dea-b04a-a18ba9690b15 with identifier: 119067642
2026-01-28 19:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3d03ab7f-48e4-5dea-b04a-a18ba9690b15 with identifier: 119067642 to the API
2026-01-28 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273d03ab7f-48e4-5dea-b04a-a18ba9690b15%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3d03ab7f-48e4-5dea-b04a-a18ba9690b15: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119067642?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3d03ab7f-48e4-5dea-b04a-a18ba9690b15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR70YDS',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119067642',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'AUDI',
'model': 'Q2 ESTATE',
'odometer': 80784,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-23',
'seller_name': 'Motability Operations',
'title': 'AUDI Q2 ESTATE 30 TFSI S Line 5dr',
'transmission': 'manual',
'trim': '30 TFSI S Line 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119067642%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Saving data for 119067642: {'created_time': 1769626988.184993, 'last_price_update_time': 1769626988.185004, 'auction_closing_time': 1770631200.0}
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119067642') HTTP/1.1" 204 0
2026-01-28 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d3c762d1-f3dd-5263-8d13-6e51961dafa2 with identifier: 119040119
2026-01-28 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d3c762d1-f3dd-5263-8d13-6e51961dafa2 with identifier: 119040119
2026-01-28 19:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d3c762d1-f3dd-5263-8d13-6e51961dafa2 with identifier: 119040119 to the API
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d3c762d1-f3dd-5263-8d13-6e51961dafa2%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d3c762d1-f3dd-5263-8d13-6e51961dafa2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119040119?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd3c762d1-f3dd-5263-8d13-6e51961dafa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AX69HDL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119040119',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'GALAXY DIESEL ESTATE',
'odometer': 61027,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-28',
'seller_name': 'UKCGR - Premium',
'title': 'FORD GALAXY DIESEL ESTATE 2.0 EcoBlue Titanium 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 EcoBlue Titanium 5dr Auto',
'vin': None,
'year': 2020}
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119040119%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Saving data for 119040119: {'created_time': 1769626988.468827, 'last_price_update_time': 1769626988.468841, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119040119') HTTP/1.1" 204 0
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 118899206
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118899206%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Scrape type for 118899206: 0
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 118720052
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118720052%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Scrape type for 118720052: 0
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 118948106
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948106%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Scrape type for 118948106: 0
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 118755550
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118755550%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Scrape type for 118755550: 0
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 119102626
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119102626%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [astonbarclay.gb] INFO: Scrape type for 119102626: 1
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fa569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900a47d0>
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F7343591a-105b-400f-8811-8803be7149ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837c6d10>
2026-01-28 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191881210>
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118735864, 'registration': 'YS72KHF', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ST-LINE PHEV CVT', 'derivative': None, 'mileage': 23852, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-19', 'fuel': 'Hybrid Electric', 'motExpiry': '2027-01-18', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 15K', 'remarks': '**288**VOSA STATES 23K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/05c75654-347c-4847-9137-21ceb4138f75.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118735864, 'registration': 'YS72KHF', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ST-LINE PHEV CVT', 'derivative': None, 'mileage': 23852, 'mileageWarranty': True, 'type': 'car', 'saleId': 18424, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-06T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-19', 'fuel': 'Hybrid Electric', 'motExpiry': '2027-01-18', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 15K', 'remarks': '**288**VOSA STATES 23K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/05c75654-347c-4847-9137-21ceb4138f75.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with identifier: 118735864
2026-01-28 19:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with scrape type 1
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 117739653
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117739653%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 117739653: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 118813061
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118813061%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 118813061: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 118685662
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118685662%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 118685662: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 118921550
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118921550%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 118921550: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 117023546: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 118949934
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118949934%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 118949934: 0
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 119060933
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060933%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [astonbarclay.gb] INFO: Scrape type for 119060933: 1
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fd6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Faa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fd6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252Fb0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319018f510>
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903672d0>
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319043b510>
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Fac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d8950>
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319015e250>
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319004d390>
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900fb790>
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fb6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902f3fd0>
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Fde39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 113583800
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27113583800%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 113583800: 0
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 118211412
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118211412%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 118211412: 0
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 117376985
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376985%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 117376985: 0
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 116988307: 0
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 119060782
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060782%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 119060782: 1
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fb8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 118594241
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118594241%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [astonbarclay.gb] INFO: Scrape type for 118594241: 2
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fda84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fc3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252Fd7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903903d0>
2026-01-28 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190072c10>
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190534b90>
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Fc5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904838d0>
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190298cd0>
2026-01-28 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900f80d0>
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191943710>
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252Fc9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319004a950>
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fbf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:13 [astonbarclay.gb] INFO: Found listing with ID: 119064671
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119064671%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [astonbarclay.gb] INFO: Scrape type for 119064671: 1
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fb7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fe0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252Fc1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:13 [astonbarclay.gb] INFO: Found listing with ID: 119090326
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119090326%27 HTTP/1.1" 200 None
2026-01-28 19:03:13 [astonbarclay.gb] INFO: Scrape type for 119090326: 1
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fbf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119062862?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Found listing with ID: 118915496
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118915496%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Scrape type for 118915496: 0
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Found listing with ID: 118710855
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118710855%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Scrape type for 118710855: 0
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Found listing with ID: 118811346
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811346%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [astonbarclay.gb] INFO: Scrape type for 118811346: 1
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Ff95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252Fe405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190186d10>
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837da010>
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252Faa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903e1f50>
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837036d0>
2026-01-28 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fde8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903e3850>
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252Fb0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183629810>
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190151ed0>
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 119104264
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119104264%27 HTTP/1.1" 200 None
2026-01-28 19:03:15 [astonbarclay.gb] INFO: Scrape type for 119104264: 1
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fc71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119037149?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118164228?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115302250?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118000107?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118094755?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190351710>
2026-01-28 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fd6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119062862, 'registration': 'H21LCK', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Acenta 5dr DCT', 'mileage': 16123, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 14K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ec2c813-9913-4ef9-bc21-f561bde659a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119062862, 'registration': 'H21LCK', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Acenta 5dr DCT', 'mileage': 16123, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 14K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ec2c813-9913-4ef9-bc21-f561bde659a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a487a0cc-073a-52c9-bd07-94541677228f with identifier: 119062862
2026-01-28 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a487a0cc-073a-52c9-bd07-94541677228f with scrape type 1
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a487a0cc-073a-52c9-bd07-94541677228f
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a487a0cc-073a-52c9-bd07-94541677228f
2026-01-28 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a487a0cc-073a-52c9-bd07-94541677228f, identifier: 119062862
2026-01-28 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 119091209
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091209%27 HTTP/1.1" 200 None
2026-01-28 19:03:16 [astonbarclay.gb] INFO: Scrape type for 119091209: 1
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Ffebf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a487a0cc-073a-52c9-bd07-94541677228f with identifier: 119062862
2026-01-28 19:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a487a0cc-073a-52c9-bd07-94541677228f with identifier: 119062862
2026-01-28 19:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a487a0cc-073a-52c9-bd07-94541677228f with identifier: 119062862 to the API
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a487a0cc-073a-52c9-bd07-94541677228f%27 HTTP/1.1" 200 None
2026-01-28 19:03:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a487a0cc-073a-52c9-bd07-94541677228f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119062862?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'a487a0cc-073a-52c9-bd07-94541677228f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'H21LCK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119062862',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 16123,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-30',
'seller_name': None,
'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 Acenta 5dr DCT',
'transmission': 'automatic',
'trim': '1.0 DiG-T 114 Acenta 5dr DCT',
'vin': None,
'year': 2022}
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119062862%27 HTTP/1.1" 200 None
2026-01-28 19:03:16 [astonbarclay.gb] INFO: Saving data for 119062862: {'created_time': 1769626996.978982, 'last_price_update_time': 1769626996.978992}
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119062862') HTTP/1.1" 204 0
2026-01-28 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 118943049
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118943049%27 HTTP/1.1" 200 None
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Scrape type for 118943049: 0
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117451336
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117451336: 0
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 118657267
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118657267%27 HTTP/1.1" 200 None
2026-01-28 19:03:17 [astonbarclay.gb] INFO: Scrape type for 118657267: 1
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903156d0>
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg HTTP/1.1" 201 0
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fda84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903005d0>
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190338190>
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252Fd7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3192e84390>
2026-01-28 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191810790>
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fc3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190301050>
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190494fd0>
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183673650>
2026-01-28 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fd6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119037149, 'registration': 'BJ67ZGR', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi Nav 5dr Auto', 'mileage': 50130, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-12-05', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a12c8742-32bb-42a7-98ea-03be9bd2e1e7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119037149, 'registration': 'BJ67ZGR', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi Nav 5dr Auto', 'mileage': 50130, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-12-05', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a12c8742-32bb-42a7-98ea-03be9bd2e1e7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afdcf725-857e-5d8a-adc6-a0f820139964 with identifier: 119037149
2026-01-28 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdcf725-857e-5d8a-adc6-a0f820139964 with scrape type 1
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item afdcf725-857e-5d8a-adc6-a0f820139964
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item afdcf725-857e-5d8a-adc6-a0f820139964
2026-01-28 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: afdcf725-857e-5d8a-adc6-a0f820139964, identifier: 119037149
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118164228, 'registration': 'LE25NFZ', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR Sport 5dr DSG', 'mileage': 5783, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-08-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/406d42d1-4dc5-4991-97b0-7f789c1fe06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/bda2d600-13c4-4b40-8b50-61a9942e1718_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/ced606d4-2b93-4ab0-930e-7f96dd4b83a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/d4518a6f-831c-4503-b940-d3ba670ef618_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/46f47c56-c788-432c-aa66-ec9dd9a60914_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/ad5de7fa-7127-4275-bdee-f9d5ff3d60cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/1c7bb93e-bf45-4a69-9e6f-029d16f695a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/e4216413-9d32-4c10-81b3-f4f4b3aaffb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/c62c63cb-7644-4f4e-bd15-81d62988855b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/a159788e-81e6-4f3e-b98f-ae45002fa432_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - V5 DOCUMENT NUMBER AVAILABLE ON REQUEST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/809f67db-1761-4104-9793-69a94b85055a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118164228, 'registration': 'LE25NFZ', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR Sport 5dr DSG', 'mileage': 5783, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-08-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/406d42d1-4dc5-4991-97b0-7f789c1fe06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/bda2d600-13c4-4b40-8b50-61a9942e1718_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/ced606d4-2b93-4ab0-930e-7f96dd4b83a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/d4518a6f-831c-4503-b940-d3ba670ef618_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/46f47c56-c788-432c-aa66-ec9dd9a60914_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/ad5de7fa-7127-4275-bdee-f9d5ff3d60cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/1c7bb93e-bf45-4a69-9e6f-029d16f695a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/e4216413-9d32-4c10-81b3-f4f4b3aaffb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/c62c63cb-7644-4f4e-bd15-81d62988855b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NFZ/2026-01-07/image/a159788e-81e6-4f3e-b98f-ae45002fa432_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - V5 DOCUMENT NUMBER AVAILABLE ON REQUEST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/809f67db-1761-4104-9793-69a94b85055a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd3384b6-b14c-545f-8496-ab8acbf390cf with identifier: 118164228
2026-01-28 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd3384b6-b14c-545f-8496-ab8acbf390cf with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd3384b6-b14c-545f-8496-ab8acbf390cf with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cd3384b6-b14c-545f-8496-ab8acbf390cf, identifier: 118164228
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115302250, 'registration': 'OW25UYT', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA ULTIMATE TURBO', 'derivative': None, 'mileage': 1674, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2d9add00-69ec-431a-b59f-6646804901af_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2598fee5-a9bb-4d48-882c-66fc9fcd2c47_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/78e63196-0324-4ea7-86df-22e1b6a3c93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/9ff8df64-544f-485a-b7a6-350c26419b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/bcd6dc97-74c4-44a0-a8ba-3147080315bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/3dde0aca-1629-4f30-801f-dc915cbf96ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/96fb26bd-3211-4983-bf61-d589cf3fcf30_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fbbf6e0-6ea2-4e5a-b6c9-f9e6fa0a610f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115302250, 'registration': 'OW25UYT', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA ULTIMATE TURBO', 'derivative': None, 'mileage': 1674, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2d9add00-69ec-431a-b59f-6646804901af_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2598fee5-a9bb-4d48-882c-66fc9fcd2c47_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/78e63196-0324-4ea7-86df-22e1b6a3c93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/9ff8df64-544f-485a-b7a6-350c26419b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/bcd6dc97-74c4-44a0-a8ba-3147080315bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/3dde0aca-1629-4f30-801f-dc915cbf96ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/96fb26bd-3211-4983-bf61-d589cf3fcf30_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fbbf6e0-6ea2-4e5a-b6c9-f9e6fa0a610f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2026-01-28 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d2d58f3-1ba0-5125-a962-254cbbade3e3, identifier: 115302250
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118000107, 'registration': 'VN74XVF', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI SE Edition 5dr', 'mileage': 24895, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VN74XVF/2025-12-16/image/16cc35cd-877a-457a-87fb-7b1df0f4a0b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/e6813ab9-ef3d-47a2-a806-18b6e90c1646_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/25f05a78-daf2-416a-9859-7719edc15296_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/c1a824e7-66b9-4992-ae10-a2c2af659cc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/2513ecce-af7e-4df9-bae8-00bc5e2f1675_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/78d66b20-b9a8-49df-b0f1-d23dea2b6e77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/43bca8e1-34a2-4fa2-acd1-5ad662a99e21_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/80b4079f-f6b4-4c2c-a43f-5bf7fda010fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/aea8d69b-a5d2-4230-97fd-9bf0067d8b81_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/e501591b-590c-45ee-afe5-aa7d28207794_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e99d0c2b-7030-4d5b-90ca-394fd3c88540.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118000107, 'registration': 'VN74XVF', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI SE Edition 5dr', 'mileage': 24895, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VN74XVF/2025-12-16/image/16cc35cd-877a-457a-87fb-7b1df0f4a0b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/e6813ab9-ef3d-47a2-a806-18b6e90c1646_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/25f05a78-daf2-416a-9859-7719edc15296_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/c1a824e7-66b9-4992-ae10-a2c2af659cc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/2513ecce-af7e-4df9-bae8-00bc5e2f1675_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/78d66b20-b9a8-49df-b0f1-d23dea2b6e77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/43bca8e1-34a2-4fa2-acd1-5ad662a99e21_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/80b4079f-f6b4-4c2c-a43f-5bf7fda010fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/aea8d69b-a5d2-4230-97fd-9bf0067d8b81_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN74XVF/2025-12-16/image/e501591b-590c-45ee-afe5-aa7d28207794_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e99d0c2b-7030-4d5b-90ca-394fd3c88540.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90947c1-10d2-5095-828a-93aa3742d7c5 with identifier: 118000107
2026-01-28 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90947c1-10d2-5095-828a-93aa3742d7c5 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90947c1-10d2-5095-828a-93aa3742d7c5 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b90947c1-10d2-5095-828a-93aa3742d7c5, identifier: 118000107
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118094755, 'registration': 'YA74HUJ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI Life 5dr', 'mileage': 16501, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/a9e6fdcd-5afd-460c-916c-9cc8368f4189_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/9ea43ed7-c812-4673-994e-b380a836a55e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/d657cb32-3668-4619-9646-760935174da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/f83318f2-2f10-4df4-89f0-88c2d4b6bb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/8f12ba25-c99d-458e-8df7-c71aeef5d150_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/f45c2665-50f1-48fb-a63d-a2e3a6bf24ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/510c700b-09c6-4dbf-9609-5ec3c9979246_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/72899c33-1477-424a-81c9-cfb6126c3b36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/76d5e6d6-4a59-43b8-b0a7-37601e7e0190_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2458f531-c224-42ca-a1a4-c7e67559ad4f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118094755, 'registration': 'YA74HUJ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI Life 5dr', 'mileage': 16501, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/a9e6fdcd-5afd-460c-916c-9cc8368f4189_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/9ea43ed7-c812-4673-994e-b380a836a55e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/d657cb32-3668-4619-9646-760935174da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/f83318f2-2f10-4df4-89f0-88c2d4b6bb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/8f12ba25-c99d-458e-8df7-c71aeef5d150_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/f45c2665-50f1-48fb-a63d-a2e3a6bf24ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/510c700b-09c6-4dbf-9609-5ec3c9979246_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/72899c33-1477-424a-81c9-cfb6126c3b36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HUJ/2025-12-18/image/76d5e6d6-4a59-43b8-b0a7-37601e7e0190_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2458f531-c224-42ca-a1a4-c7e67559ad4f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05abbea4-0490-5073-a5f2-4535a691b098 with identifier: 118094755
2026-01-28 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05abbea4-0490-5073-a5f2-4535a691b098 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05abbea4-0490-5073-a5f2-4535a691b098 with scrape type 2
2026-01-28 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05abbea4-0490-5073-a5f2-4535a691b098, identifier: 118094755
2026-01-28 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: afdcf725-857e-5d8a-adc6-a0f820139964 with identifier: 119037149
2026-01-28 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: afdcf725-857e-5d8a-adc6-a0f820139964 with identifier: 119037149
2026-01-28 19:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: afdcf725-857e-5d8a-adc6-a0f820139964 with identifier: 119037149 to the API
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27afdcf725-857e-5d8a-adc6-a0f820139964%27 HTTP/1.1" 200 None
2026-01-28 19:03:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id afdcf725-857e-5d8a-adc6-a0f820139964: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119037149?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 160,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'afdcf725-857e-5d8a-adc6-a0f820139964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BJ67ZGR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119037149',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 50130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-05',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL ZAFIRA TOURER 1.4T SRi Nav 5dr Auto',
'transmission': 'automatic',
'trim': '1.4T SRi Nav 5dr Auto',
'vin': None,
'year': 2017}
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037149%27 HTTP/1.1" 200 None
2026-01-28 19:03:19 [astonbarclay.gb] INFO: Saving data for 119037149: {'created_time': 1769626999.920934, 'last_price_update_time': 1769626999.920944, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119037149') HTTP/1.1" 204 0
2026-01-28 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cd3384b6-b14c-545f-8496-ab8acbf390cf with identifier: 118164228
2026-01-28 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cd3384b6-b14c-545f-8496-ab8acbf390cf with identifier: 118164228
2026-01-28 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cd3384b6-b14c-545f-8496-ab8acbf390cf with identifier: 118164228 to the API
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118164228?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cd3384b6-b14c-545f-8496-ab8acbf390cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LE25NFZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118164228',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'SEAT',
'model': 'ARONA HATCHBACK',
'odometer': 5783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-08-26',
'seller_name': 'Motability Operations',
'title': 'SEAT ARONA HATCHBACK 1.0 TSI 115 FR Sport 5dr DSG',
'transmission': 'automatic',
'trim': '1.0 TSI 115 FR Sport 5dr DSG',
'vin': None,
'year': 2025}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118164228%27 HTTP/1.1" 200 None
2026-01-28 19:03:20 [astonbarclay.gb] INFO: Saving data for 118164228: {'auction_closing_time': 1770631200.0, 'created_time': 1768331828.257202, 'last_price_update_time': 1769627000.223592}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118164228') HTTP/1.1" 204 0
2026-01-28 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2026-01-28 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2026-01-28 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250 to the API
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:20 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d2d58f3-1ba0-5125-a962-254cbbade3e3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115302250?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d2d58f3-1ba0-5125-a962-254cbbade3e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'OW25UYT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115302250',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'CORSA ULTIMATE TURBO',
'odometer': 1674,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-30',
'seller_name': 'Motability Operations',
'title': 'VAUXHALL CORSA ULTIMATE TURBO None',
'transmission': 'manual',
'trim': None,
'vin': None,
'year': 2025}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2026-01-28 19:03:20 [astonbarclay.gb] INFO: Saving data for 115302250: {'auction_closing_time': 1770631200.0, 'created_time': 1767987829.447317, 'last_price_update_time': 1769627000.497508}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115302250') HTTP/1.1" 204 0
2026-01-28 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b90947c1-10d2-5095-828a-93aa3742d7c5 with identifier: 118000107
2026-01-28 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b90947c1-10d2-5095-828a-93aa3742d7c5 with identifier: 118000107
2026-01-28 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b90947c1-10d2-5095-828a-93aa3742d7c5 with identifier: 118000107 to the API
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118000107?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b90947c1-10d2-5095-828a-93aa3742d7c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VN74XVF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118000107',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'SKODA',
'model': 'KAMIQ HATCHBACK',
'odometer': 24895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-17',
'seller_name': 'Motability Operations',
'title': 'SKODA KAMIQ HATCHBACK 1.0 TSI SE Edition 5dr',
'transmission': 'manual',
'trim': '1.0 TSI SE Edition 5dr',
'vin': None,
'year': 2025}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118000107%27 HTTP/1.1" 200 None
2026-01-28 19:03:20 [astonbarclay.gb] INFO: Saving data for 118000107: {'auction_closing_time': 1770631200.0, 'created_time': 1768331755.331203, 'last_price_update_time': 1769627000.806932}
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118000107') HTTP/1.1" 204 0
2026-01-28 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05abbea4-0490-5073-a5f2-4535a691b098 with identifier: 118094755
2026-01-28 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05abbea4-0490-5073-a5f2-4535a691b098 with identifier: 118094755
2026-01-28 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 05abbea4-0490-5073-a5f2-4535a691b098 with identifier: 118094755 to the API
2026-01-28 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118094755?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GREEN',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05abbea4-0490-5073-a5f2-4535a691b098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YA74HUJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118094755',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VOLKSWAGEN',
'model': 'TAIGO HATCHBACK',
'odometer': 16501,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-31',
'seller_name': 'Motability Operations',
'title': 'VOLKSWAGEN TAIGO HATCHBACK 1.0 TSI Life 5dr',
'transmission': 'manual',
'trim': '1.0 TSI Life 5dr',
'vin': None,
'year': 2025}
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118094755%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Saving data for 118094755: {'auction_closing_time': 1770631200.0, 'created_time': 1768331698.26969, 'last_price_update_time': 1769627001.117107}
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118094755') HTTP/1.1" 204 0
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 118919315
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118919315%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Scrape type for 118919315: 0
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 119105202
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119105202%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Scrape type for 119105202: 1
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118594241?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119060933, 'registration': 'LB67CBU', 'account': 'WBA001', 'make': 'BMW', 'model': 'X1 DIESEL ESTATE', 'derivative': 'sDrive 18d xLine 5dr Step Auto', 'mileage': 166135, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-12-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**449**VOSA STATES 99K, 122K, 150K, 155K, 162K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cb7dc77-c095-4ad2-8546-07feacc870ab.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119060933, 'registration': 'LB67CBU', 'account': 'WBA001', 'make': 'BMW', 'model': 'X1 DIESEL ESTATE', 'derivative': 'sDrive 18d xLine 5dr Step Auto', 'mileage': 166135, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-12-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**449**VOSA STATES 99K, 122K, 150K, 155K, 162K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cb7dc77-c095-4ad2-8546-07feacc870ab.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181a8653-7cbf-555f-abb0-d617f8adbb48 with identifier: 119060933
2026-01-28 19:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181a8653-7cbf-555f-abb0-d617f8adbb48 with scrape type 1
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319042ec90>
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252Fc1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 119099154
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099154%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Scrape type for 119099154: 1
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 119060536
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060536%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [astonbarclay.gb] INFO: Scrape type for 119060536: 1
2026-01-28 19:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fc408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d1550>
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fbf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190491a10>
2026-01-28 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252Fe405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319030b8d0>
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837026d0>
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319036f9d0>
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Ff95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190490510>
2026-01-28 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901065d0>
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183785d50>
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118594241, 'registration': 'EN17SYU', 'account': 'ESS030', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 93711, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN17SYU/2026-01-15/image/f2f52099-9ce1-4416-bd1d-f3f424b1dfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/184017d0-acf0-45b4-8a55-afa28515f642_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/98b46b35-2562-412a-8c23-d7228db1f40e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/16a3a43c-f7f6-419d-ab30-682d3561ae3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/085e0061-3472-4f26-9589-5429e0861551_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/d52480df-2723-4233-853b-ee598d6e9003_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/43acf093-477a-4110-bde0-8227c1642e73_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/e9fb792e-62c1-4184-8f92-b9fa5d092a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/68421d29-8adf-45e9-966d-c8d0782820e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/3d5ea191-ef17-46de-afc7-ff07968e17b2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/18 7K - 07/19 14K - 02/21 29K - 08/23 63K - 08/24 77K', 'remarks': 'NO V5 FRONT PAGE ONLY - VOSA STATES, 46K, 61K, 75K, 87K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c193ba8-2b2c-431c-bade-607e374b660b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118594241, 'registration': 'EN17SYU', 'account': 'ESS030', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 93711, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN17SYU/2026-01-15/image/f2f52099-9ce1-4416-bd1d-f3f424b1dfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/184017d0-acf0-45b4-8a55-afa28515f642_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/98b46b35-2562-412a-8c23-d7228db1f40e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/16a3a43c-f7f6-419d-ab30-682d3561ae3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/085e0061-3472-4f26-9589-5429e0861551_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/d52480df-2723-4233-853b-ee598d6e9003_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/43acf093-477a-4110-bde0-8227c1642e73_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/e9fb792e-62c1-4184-8f92-b9fa5d092a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/68421d29-8adf-45e9-966d-c8d0782820e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17SYU/2026-01-15/image/3d5ea191-ef17-46de-afc7-ff07968e17b2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/18 7K - 07/19 14K - 02/21 29K - 08/23 63K - 08/24 77K', 'remarks': 'NO V5 FRONT PAGE ONLY - VOSA STATES, 46K, 61K, 75K, 87K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c193ba8-2b2c-431c-bade-607e374b660b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e01dd4-b5c9-54bb-950d-080bed99a7fe with identifier: 118594241
2026-01-28 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e01dd4-b5c9-54bb-950d-080bed99a7fe with scrape type 2
2026-01-28 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e01dd4-b5c9-54bb-950d-080bed99a7fe with scrape type 2
2026-01-28 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22e01dd4-b5c9-54bb-950d-080bed99a7fe, identifier: 118594241
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 118897733
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118897733%27 HTTP/1.1" 200 None
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Scrape type for 118897733: 0
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 119075275
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119075275%27 HTTP/1.1" 200 None
2026-01-28 19:03:23 [astonbarclay.gb] INFO: Scrape type for 119075275: 1
2026-01-28 19:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22e01dd4-b5c9-54bb-950d-080bed99a7fe with identifier: 118594241
2026-01-28 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22e01dd4-b5c9-54bb-950d-080bed99a7fe with identifier: 118594241
2026-01-28 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150812 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150812
2026-01-28 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 22e01dd4-b5c9-54bb-950d-080bed99a7fe spider: astonbarclay.gb
2026-01-28 19:03:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 22e01dd4-b5c9-54bb-950d-080bed99a7fe due to rule: high_mileage_for_country.json, error: 150812 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150812
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '22e01dd4-b5c9-54bb-950d-080bed99a7fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EN17SYU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118594241',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FOCUS HATCHBACK',
'odometer': 93711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seller_name': 'SMC GROUP',
'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 125 Titanium 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118594241%27 HTTP/1.1" 200 None
2026-01-28 19:03:24 [astonbarclay.gb] INFO: Saving data for 118594241: {'auction_closing_time': 1769594400.0, 'created_time': 1768503996.857981, 'last_price_update_time': 1769627004.098282}
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118594241') HTTP/1.1" 204 0
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119104264?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118811346?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916b4590>
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916aa610>
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903f2cd0>
2026-01-28 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916ae310>
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Ffebf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735864?view=catalogue)
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d2f90>
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904e7390>
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028a210>
2026-01-28 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fc71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183702e50>
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183703fd0>
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318376fb50>
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fb7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183702e50>
2026-01-28 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252Fe0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119104264, 'registration': 'MH68OXJ', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 [112] Bose Personal Edition 5dr', 'mileage': 82618, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-01-26', 'fuel': 'Petrol', 'motExpiry': '2026-01-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 36K 45K 55K 71K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119104264, 'registration': 'MH68OXJ', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 [112] Bose Personal Edition 5dr', 'mileage': 82618, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-01-26', 'fuel': 'Petrol', 'motExpiry': '2026-01-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 36K 45K 55K 71K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c236f5-b1ae-5696-9b09-9f49e0f7a16e with identifier: 119104264
2026-01-28 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c236f5-b1ae-5696-9b09-9f49e0f7a16e with scrape type 1
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f8c236f5-b1ae-5696-9b09-9f49e0f7a16e
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f8c236f5-b1ae-5696-9b09-9f49e0f7a16e
2026-01-28 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8c236f5-b1ae-5696-9b09-9f49e0f7a16e, identifier: 119104264
2026-01-28 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118811346, 'registration': 'YL70LDN', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 [157] N-Connecta 5dr DCT Glass Roof', 'mileage': 62006, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 56K 60K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118811346, 'registration': 'YL70LDN', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 [157] N-Connecta 5dr DCT Glass Roof', 'mileage': 62006, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 56K 60K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4dcd418-611f-51a1-b2d3-8d40b72ca540 with identifier: 118811346
2026-01-28 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4dcd418-611f-51a1-b2d3-8d40b72ca540 with scrape type 1
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e4dcd418-611f-51a1-b2d3-8d40b72ca540
2026-01-28 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e4dcd418-611f-51a1-b2d3-8d40b72ca540
2026-01-28 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e4dcd418-611f-51a1-b2d3-8d40b72ca540, identifier: 118811346
2026-01-28 19:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8c236f5-b1ae-5696-9b09-9f49e0f7a16e with identifier: 119104264
2026-01-28 19:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8c236f5-b1ae-5696-9b09-9f49e0f7a16e with identifier: 119104264
2026-01-28 19:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8c236f5-b1ae-5696-9b09-9f49e0f7a16e with identifier: 119104264 to the API
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f8c236f5-b1ae-5696-9b09-9f49e0f7a16e%27 HTTP/1.1" 200 None
2026-01-28 19:03:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f8c236f5-b1ae-5696-9b09-9f49e0f7a16e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119104264?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'f8c236f5-b1ae-5696-9b09-9f49e0f7a16e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MH68OXJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119104264',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 82618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-26',
'seller_name': None,
'title': 'NISSAN JUKE HATCHBACK 1.6 [112] Bose Personal Edition 5dr',
'transmission': 'manual',
'trim': '1.6 [112] Bose Personal Edition 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119104264%27 HTTP/1.1" 200 None
2026-01-28 19:03:27 [astonbarclay.gb] INFO: Saving data for 119104264: {'created_time': 1769627007.750125, 'last_price_update_time': 1769627007.750136}
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119104264') HTTP/1.1" 204 0
2026-01-28 19:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e4dcd418-611f-51a1-b2d3-8d40b72ca540 with identifier: 118811346
2026-01-28 19:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e4dcd418-611f-51a1-b2d3-8d40b72ca540 with identifier: 118811346
2026-01-28 19:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e4dcd418-611f-51a1-b2d3-8d40b72ca540 with identifier: 118811346 to the API
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e4dcd418-611f-51a1-b2d3-8d40b72ca540%27 HTTP/1.1" 200 None
2026-01-28 19:03:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e4dcd418-611f-51a1-b2d3-8d40b72ca540: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118811346?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'e4dcd418-611f-51a1-b2d3-8d40b72ca540',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YL70LDN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118811346',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 62006,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-31',
'seller_name': None,
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T 160 [157] N-Connecta 5dr DCT '
'Glass Roof',
'transmission': 'automatic',
'trim': '1.3 DiG-T 160 [157] N-Connecta 5dr DCT Glass Roof',
'vin': None,
'year': 2021}
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811346%27 HTTP/1.1" 200 None
2026-01-28 19:03:28 [astonbarclay.gb] INFO: Saving data for 118811346: {'created_time': 1769627008.040515, 'last_price_update_time': 1769627008.040527}
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118811346') HTTP/1.1" 204 0
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fb864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119042739?view=catalogue)
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118698130?view=catalogue)
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119105202?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118657267?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190218e50>
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318367b990>
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901aa290>
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg HTTP/1.1" 201 0
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a8f10>
2026-01-28 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS72KHF%252F2026-01-19%252Fimage%252F679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8
2026-01-28 19:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbb0206d-1b3a-5be4-af99-c13e4b4451b8, skipping ID generation
2026-01-28 19:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with scrape type 1
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cbb0206d-1b3a-5be4-af99-c13e4b4451b8 from tracking dictionaries
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbb0206d-1b3a-5be4-af99-c13e4b4451b8 sending to next pipeline
2026-01-28 19:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbb0206d-1b3a-5be4-af99-c13e4b4451b8, identifier: 118735864
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009d550>
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fc408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901052d0>
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252Fb8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with identifier: 118735864
2026-01-28 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with identifier: 118735864
2026-01-28 19:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbb0206d-1b3a-5be4-af99-c13e4b4451b8 with identifier: 118735864 to the API
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id cbb0206d-1b3a-5be4-af99-c13e4b4451b8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Hybrid Electric',
'id': 'cbb0206d-1b3a-5be4-af99-c13e4b4451b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YS72KHF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118735864',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'KUGA ST-LINE PHEV CVT',
'odometer': 23852,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35394,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/679aeb78-570a-45cb-a2c1-365cdf7ba73b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37880,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/65c79667-d640-4931-873a-e65da3cb476c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33170,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/160c8c0a-1fd7-49fb-a40a-084864dc0f01_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34380,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/80fd8b7d-773d-49e6-8638-7114e29ce6f9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42024,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/c1cb64ab-bfbe-47d7-8f5d-64d49b438e92_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57878,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/31569319-b19d-4643-83a0-fe67fac37f73_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53260,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/e405748a-d42e-4682-b337-3c930e5f3dac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47770,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/8d00bf2d-c0ff-4088-9c4c-e618783d3e96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb0206d-1b3a-5be4-af99-c13e4b4451b8/cbb0206d-1b3a-5be4-af99-c13e4b4451b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57073,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YS72KHF/2026-01-19/image/522c8aa4-37e1-44c0-b6da-63b6fa1c3fe1_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-19',
'seller_name': 'Kinto',
'title': 'FORD KUGA ST-LINE PHEV CVT None',
'transmission': 'automatic',
'trim': None,
'vin': None,
'year': 2023}
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735864%27 HTTP/1.1" 200 None
2026-01-28 19:03:30 [astonbarclay.gb] INFO: Saving data for 118735864: {'created_time': 1769627010.263974, 'last_price_update_time': 1769627010.263986, 'auction_closing_time': 1770371100.0}
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118735864') HTTP/1.1" 204 0
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119033233?view=catalogue)
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fb8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119091209?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119090326?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bc0d0>
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902d8f10>
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190474210>
2026-01-28 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b9950>
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190641610>
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMK18LCZ%252F2026-01-28%252Fimage%252F53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4445c656-e70d-5b90-b0fb-af9a7abb8560
2026-01-28 19:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4445c656-e70d-5b90-b0fb-af9a7abb8560, skipping ID generation
2026-01-28 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4445c656-e70d-5b90-b0fb-af9a7abb8560 with scrape type 1
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4445c656-e70d-5b90-b0fb-af9a7abb8560 from tracking dictionaries
2026-01-28 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4445c656-e70d-5b90-b0fb-af9a7abb8560 sending to next pipeline
2026-01-28 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4445c656-e70d-5b90-b0fb-af9a7abb8560, identifier: 119042739
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31918dd4d0>
2026-01-28 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72UJH%252F2026-01-19%252Fimage%252F1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e015206-9819-59a6-9468-3e3fc8eaab9b
2026-01-28 19:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e015206-9819-59a6-9468-3e3fc8eaab9b, skipping ID generation
2026-01-28 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e015206-9819-59a6-9468-3e3fc8eaab9b with scrape type 1
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8e015206-9819-59a6-9468-3e3fc8eaab9b from tracking dictionaries
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e015206-9819-59a6-9468-3e3fc8eaab9b sending to next pipeline
2026-01-28 19:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8e015206-9819-59a6-9468-3e3fc8eaab9b, identifier: 118698130
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119105202, 'registration': 'YX20YJP', 'account': 'WBA001', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport II 3dr', 'mileage': 49413, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-03-12', 'fuel': 'Petrol', 'motExpiry': '2026-03-13', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 29K, 35K, 40K,', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119105202, 'registration': 'YX20YJP', 'account': 'WBA001', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport II 3dr', 'mileage': 49413, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-03-12', 'fuel': 'Petrol', 'motExpiry': '2026-03-13', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 29K, 35K, 40K,', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 019e05be-42b5-5c81-a4bb-8b993ddde6a9 with identifier: 119105202
2026-01-28 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 019e05be-42b5-5c81-a4bb-8b993ddde6a9 with scrape type 1
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 019e05be-42b5-5c81-a4bb-8b993ddde6a9
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 019e05be-42b5-5c81-a4bb-8b993ddde6a9
2026-01-28 19:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 019e05be-42b5-5c81-a4bb-8b993ddde6a9, identifier: 119105202
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118657267, 'registration': 'DU72YBZ', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Premium 5dr 2WD', 'mileage': 44182, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service digital 08/23-9k, 06/24-20k, 01/25-31k, 08/25-40k,', 'remarks': 'vosa states 40k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1236464-a354-429f-a76a-e1dab320cbc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118657267, 'registration': 'DU72YBZ', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Premium 5dr 2WD', 'mileage': 44182, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service digital 08/23-9k, 06/24-20k, 01/25-31k, 08/25-40k,', 'remarks': 'vosa states 40k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1236464-a354-429f-a76a-e1dab320cbc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d713dde-d192-5ac6-be93-5f696c44fa29 with identifier: 118657267
2026-01-28 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d713dde-d192-5ac6-be93-5f696c44fa29 with scrape type 1
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6d713dde-d192-5ac6-be93-5f696c44fa29
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6d713dde-d192-5ac6-be93-5f696c44fa29
2026-01-28 19:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6d713dde-d192-5ac6-be93-5f696c44fa29, identifier: 118657267
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119064671, 'registration': 'RE68AWW', 'account': 'WBA001', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper 5dr', 'mileage': 62514, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-27', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/25- 58K', 'remarks': '**647** VOSA STATES 17K, 27K, 40K, 50K, 58K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c750371c-e1b4-4270-be3c-f6ed0b4e5064.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119064671, 'registration': 'RE68AWW', 'account': 'WBA001', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper 5dr', 'mileage': 62514, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-27', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/25- 58K', 'remarks': '**647** VOSA STATES 17K, 27K, 40K, 50K, 58K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c750371c-e1b4-4270-be3c-f6ed0b4e5064.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd345fa4-483b-5805-8fbb-be6be373359f with identifier: 119064671
2026-01-28 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd345fa4-483b-5805-8fbb-be6be373359f with scrape type 1
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4445c656-e70d-5b90-b0fb-af9a7abb8560 with identifier: 119042739
2026-01-28 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4445c656-e70d-5b90-b0fb-af9a7abb8560 with identifier: 119042739
2026-01-28 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4445c656-e70d-5b90-b0fb-af9a7abb8560 with identifier: 119042739 to the API
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4445c656-e70d-5b90-b0fb-af9a7abb8560',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MK18LCZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119042739',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'ECOSPORT DIESEL HATCHBACK',
'odometer': 50175,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38054,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/24af8a1a-fc5a-46e2-ae5f-a11b6cf7852d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37281,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/53ae73c7-24d3-4ba5-8d72-8583df1213f4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33894,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/d6294eb8-085f-4fff-b2e9-2c8495291d02_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30647,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/6667c2c0-dff6-4e72-98f6-d5874c477fb0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44525,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/8c39f338-b229-4d5a-a833-49431ae41f7f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49868,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/e0274483-7919-4f62-8b3a-b7f4eaf3484e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60380,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/bf873439-3c00-4637-bcb8-a9fb02df31b5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37631,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/f95f1867-a97e-41bb-b4d2-4b2e70e3b238_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52935,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/71bae856-7be8-4f13-ae1c-3137a20c19f7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46611,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/febf72cb-3a7a-4509-8710-0ff94ae87f88_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4445c656-e70d-5b90-b0fb-af9a7abb8560/4445c656-e70d-5b90-b0fb-af9a7abb8560_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 13643,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MK18LCZ/2026-01-28/image/942201c2-30df-4ef7-a6ed-e0085b19520e_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': 'UKCGR - Premium',
'title': 'FORD ECOSPORT DIESEL HATCHBACK 1.5 TDCi Titanium 5dr',
'transmission': 'manual',
'trim': '1.5 TDCi Titanium 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119042739%27 HTTP/1.1" 200 None
2026-01-28 19:03:32 [astonbarclay.gb] INFO: Saving data for 119042739: {'created_time': 1769627012.733373, 'last_price_update_time': 1769627012.733385, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119042739') HTTP/1.1" 204 0
2026-01-28 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8e015206-9819-59a6-9468-3e3fc8eaab9b with identifier: 118698130
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:03:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FLPG HTTP/1.1" 200 None
2026-01-28 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8e015206-9819-59a6-9468-3e3fc8eaab9b with identifier: 118698130
2026-01-28 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8e015206-9819-59a6-9468-3e3fc8eaab9b with identifier: 118698130 to the API
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Petrol/LPG',
'id': '8e015206-9819-59a6-9468-3e3fc8eaab9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MW72UJH',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118698130',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'DACIA',
'model': 'SANDERO HATCHBACK',
'odometer': 23311,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29223,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/8a307884-43ab-4957-a1ce-ccf9ba96baf7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28777,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/1cecd9a6-c7da-45d0-afd8-0deb7d3eefad_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27046,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/b0050c1a-aff3-41d1-ab04-0ea4895fca2e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28407,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/71fe6e00-c34e-4dd9-bb3a-73b199b16c4f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33835,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/d7aaad21-4735-42b8-ba67-6113481a1c3d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55313,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/88dba7e8-903c-4dfa-ba28-84b5a45ed998_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32769,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/64feb67f-d5cc-494a-b68d-2ff4f90678d4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43083,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9811d11e-883e-4fe4-b36a-c1bd8a15985d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e015206-9819-59a6-9468-3e3fc8eaab9b/8e015206-9819-59a6-9468-3e3fc8eaab9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44920,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/MW72UJH/2026-01-19/image/9011b1e3-def4-4a70-8a5b-a2d318c59955_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-14',
'seller_name': 'Kinto',
'title': 'DACIA SANDERO HATCHBACK 1.0 TCe Bi-Fuel Comfort 5dr',
'transmission': 'manual',
'trim': '1.0 TCe Bi-Fuel Comfort 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118698130%27 HTTP/1.1" 200 None
2026-01-28 19:03:33 [astonbarclay.gb] INFO: Saving data for 118698130: {'created_time': 1769627013.677229, 'last_price_update_time': 1769627013.677241, 'auction_closing_time': 1770371100.0}
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118698130') HTTP/1.1" 204 0
2026-01-28 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 019e05be-42b5-5c81-a4bb-8b993ddde6a9 with identifier: 119105202
2026-01-28 19:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 019e05be-42b5-5c81-a4bb-8b993ddde6a9 with identifier: 119105202
2026-01-28 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 019e05be-42b5-5c81-a4bb-8b993ddde6a9 with identifier: 119105202 to the API
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27019e05be-42b5-5c81-a4bb-8b993ddde6a9%27 HTTP/1.1" 200 None
2026-01-28 19:03:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 019e05be-42b5-5c81-a4bb-8b993ddde6a9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119105202?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '019e05be-42b5-5c81-a4bb-8b993ddde6a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YX20YJP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119105202',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MINI',
'model': 'HATCHBACK',
'odometer': 49413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-12',
'seller_name': 'UKCGR',
'title': 'MINI HATCHBACK 1.5 Cooper Sport II 3dr',
'transmission': 'manual',
'trim': '1.5 Cooper Sport II 3dr',
'vin': None,
'year': 2020}
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119105202%27 HTTP/1.1" 200 None
2026-01-28 19:03:34 [astonbarclay.gb] INFO: Saving data for 119105202: {'created_time': 1769627014.000223, 'last_price_update_time': 1769627014.000238}
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119105202') HTTP/1.1" 204 0
2026-01-28 19:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6d713dde-d192-5ac6-be93-5f696c44fa29 with identifier: 118657267
2026-01-28 19:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6d713dde-d192-5ac6-be93-5f696c44fa29 with identifier: 118657267
2026-01-28 19:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6d713dde-d192-5ac6-be93-5f696c44fa29 with identifier: 118657267 to the API
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276d713dde-d192-5ac6-be93-5f696c44fa29%27 HTTP/1.1" 200 None
2026-01-28 19:03:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6d713dde-d192-5ac6-be93-5f696c44fa29: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118657267?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '6d713dde-d192-5ac6-be93-5f696c44fa29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DU72YBZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118657267',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'HYUNDAI',
'model': 'TUCSON ESTATE',
'odometer': 44182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-01',
'seller_name': 'Zenith',
'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Premium 5dr 2WD',
'transmission': 'manual',
'trim': '1.6 TGDi Premium 5dr 2WD',
'vin': None,
'year': 2022}
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118657267%27 HTTP/1.1" 200 None
2026-01-28 19:03:34 [astonbarclay.gb] INFO: Saving data for 118657267: {'created_time': 1769627014.292889, 'last_price_update_time': 1769627014.292899}
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118657267') HTTP/1.1" 204 0
2026-01-28 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Facabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190462f50>
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK71XNU%252F2026-01-28%252Fimage%252F789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b433f74b-c443-5afb-9342-1f0b9b16526a
2026-01-28 19:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b433f74b-c443-5afb-9342-1f0b9b16526a, skipping ID generation
2026-01-28 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b433f74b-c443-5afb-9342-1f0b9b16526a with scrape type 1
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b433f74b-c443-5afb-9342-1f0b9b16526a from tracking dictionaries
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b433f74b-c443-5afb-9342-1f0b9b16526a sending to next pipeline
2026-01-28 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b433f74b-c443-5afb-9342-1f0b9b16526a, identifier: 119033233
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183757610>
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837e5dd0>
2026-01-28 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31917f4cd0>
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183629510>
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fa569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902afe10>
2026-01-28 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119091209, 'registration': 'ND16GMU', 'account': 'WBA001', 'make': 'BMW', 'model': 'M5 SALOON', 'derivative': 'M5 4dr DCT', 'mileage': 72813, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-07-10', 'doors': 4, 'engineSize': 4395, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**595** EVIDENCE OF NON STANDARD MODIFICATIONS', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 231, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119091209, 'registration': 'ND16GMU', 'account': 'WBA001', 'make': 'BMW', 'model': 'M5 SALOON', 'derivative': 'M5 4dr DCT', 'mileage': 72813, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-07-10', 'doors': 4, 'engineSize': 4395, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**595** EVIDENCE OF NON STANDARD MODIFICATIONS', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 231, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 868e1312-10c2-5184-abc9-3c64c4259468 with identifier: 119091209
2026-01-28 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 868e1312-10c2-5184-abc9-3c64c4259468 with scrape type 1
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 868e1312-10c2-5184-abc9-3c64c4259468
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 868e1312-10c2-5184-abc9-3c64c4259468
2026-01-28 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 868e1312-10c2-5184-abc9-3c64c4259468, identifier: 119091209
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119060782, 'registration': 'FY21AUL', 'account': 'WBA001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T Tekna 5dr DCT', 'mileage': 44541, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-03-25', 'fuel': 'Petrol', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/22- 13K', 'remarks': '**688** VOSA STATES 33K, 39K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/964276c8-f437-4d5c-80ae-0bcd456b1b8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119060782, 'registration': 'FY21AUL', 'account': 'WBA001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T Tekna 5dr DCT', 'mileage': 44541, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-03-25', 'fuel': 'Petrol', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/22- 13K', 'remarks': '**688** VOSA STATES 33K, 39K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/964276c8-f437-4d5c-80ae-0bcd456b1b8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eda265a0-230d-59e5-af26-f5a66aad8440 with identifier: 119060782
2026-01-28 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eda265a0-230d-59e5-af26-f5a66aad8440 with scrape type 1
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119090326, 'registration': 'DN73LKD', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech hybrid 145 Engineered BOSE Edn 5dr Auto', 'mileage': 8558, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-11-24', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d02d0657-95ed-4a22-8c44-54bf7af84a3c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119090326, 'registration': 'DN73LKD', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech hybrid 145 Engineered BOSE Edn 5dr Auto', 'mileage': 8558, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-11-24', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d02d0657-95ed-4a22-8c44-54bf7af84a3c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca94281-b7e6-5eb4-bbfc-b3e22952b30c with identifier: 119090326
2026-01-28 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca94281-b7e6-5eb4-bbfc-b3e22952b30c with scrape type 1
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eca94281-b7e6-5eb4-bbfc-b3e22952b30c
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eca94281-b7e6-5eb4-bbfc-b3e22952b30c
2026-01-28 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eca94281-b7e6-5eb4-bbfc-b3e22952b30c, identifier: 119090326
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119060536, 'registration': 'RJ20KKR', 'account': 'WBA001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 31879, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-07-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-20', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/25- 22K,', 'remarks': '**420** VOSA STATES 19K, 22K, 22K, 31K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f086b1b8-2eef-43ea-ada3-ea5261c3a975.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119060536, 'registration': 'RJ20KKR', 'account': 'WBA001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 31879, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-07-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-20', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/25- 22K,', 'remarks': '**420** VOSA STATES 19K, 22K, 22K, 31K SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f086b1b8-2eef-43ea-ada3-ea5261c3a975.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with identifier: 119060536
2026-01-28 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with scrape type 1
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119099154?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b433f74b-c443-5afb-9342-1f0b9b16526a with identifier: 119033233
2026-01-28 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b433f74b-c443-5afb-9342-1f0b9b16526a with identifier: 119033233
2026-01-28 19:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b433f74b-c443-5afb-9342-1f0b9b16526a with identifier: 119033233 to the API
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b433f74b-c443-5afb-9342-1f0b9b16526a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EK71XNU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119033233',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS HATCHBACK SPECIAL EDITIONS',
'odometer': 38169,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33475,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/8df7f500-83a0-4de4-8be6-b64efa0a5000_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33614,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/789e4dd5-667e-415f-8bb6-c3f927ad8f04_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34235,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/09f6bbfc-eebe-4581-bd9f-f923ca1540c3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36354,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b8a559f2-bc7c-4e8d-aa7b-ba926b61958a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45234,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c3380a64-9bc0-45bb-95bd-69ec864eab26_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55186,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/b7162b37-0654-47bc-b10f-91d5e63fe07b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45670,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/820ef4e8-b596-4910-a994-2659bff1769d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29659,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/311e1747-dba9-4b89-9c75-d81269586709_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b433f74b-c443-5afb-9342-1f0b9b16526a/b433f74b-c443-5afb-9342-1f0b9b16526a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48167,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EK71XNU/2026-01-28/image/c71b3512-5e82-4472-9800-fcdc11b50cf8_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-14',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ A CLASS HATCHBACK SPECIAL EDITIONS A180 AMG Line '
'Executive Edition 5dr Auto',
'transmission': 'automatic',
'trim': 'A180 AMG Line Executive Edition 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119033233%27 HTTP/1.1" 200 None
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Saving data for 119033233: {'created_time': 1769627016.718226, 'last_price_update_time': 1769627016.718237, 'auction_closing_time': 1770199200.0}
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119033233') HTTP/1.1" 204 0
2026-01-28 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 868e1312-10c2-5184-abc9-3c64c4259468 with identifier: 119091209
2026-01-28 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 868e1312-10c2-5184-abc9-3c64c4259468 with identifier: 119091209
2026-01-28 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 868e1312-10c2-5184-abc9-3c64c4259468 spider: astonbarclay.gb
2026-01-28 19:03:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 868e1312-10c2-5184-abc9-3c64c4259468 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 231,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '4.4L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': '868e1312-10c2-5184-abc9-3c64c4259468',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ND16GMU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119091209',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': 'M5 SALOON',
'odometer': 72813,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-27',
'seller_name': 'UKCGR',
'title': 'BMW M5 SALOON M5 4dr DCT',
'transmission': 'automatic',
'trim': 'M5 4dr DCT',
'vin': None,
'year': 2016}
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091209%27 HTTP/1.1" 200 None
2026-01-28 19:03:36 [astonbarclay.gb] INFO: Saving data for 119091209: {'created_time': 1769627016.930335, 'last_price_update_time': 1769627016.930349}
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119091209') HTTP/1.1" 204 0
2026-01-28 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eca94281-b7e6-5eb4-bbfc-b3e22952b30c with identifier: 119090326
2026-01-28 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY%2FBLACK HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eca94281-b7e6-5eb4-bbfc-b3e22952b30c with identifier: 119090326
2026-01-28 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eca94281-b7e6-5eb4-bbfc-b3e22952b30c with identifier: 119090326 to the API
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27eca94281-b7e6-5eb4-bbfc-b3e22952b30c%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id eca94281-b7e6-5eb4-bbfc-b3e22952b30c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119090326?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': None,
'fuel_type': 'Petrol/Electric Hybrid',
'id': 'eca94281-b7e6-5eb4-bbfc-b3e22952b30c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DN73LKD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119090326',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'RENAULT',
'model': 'CAPTUR HATCHBACK',
'odometer': 8558,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-24',
'seller_name': None,
'title': 'RENAULT CAPTUR HATCHBACK 1.6 E-Tech hybrid 145 Engineered BOSE Edn '
'5dr Auto',
'transmission': 'automatic',
'trim': '1.6 E-Tech hybrid 145 Engineered BOSE Edn 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119090326%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [astonbarclay.gb] INFO: Saving data for 119090326: {'created_time': 1769627017.450209, 'last_price_update_time': 1769627017.45022}
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119090326') HTTP/1.1" 204 0
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Fb14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119102626?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252Fa8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191667710>
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fb864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31917b1810>
2026-01-28 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Fa263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190400810>
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F02f2c698-add8-423d-b384-813724e00696_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119099154, 'registration': 'FN72LJA', 'account': 'RCI014', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 150 Prestige 5dr EDC', 'mileage': 21081, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 19K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/08787cb7-243b-42dc-8ba1-ca04bffe1366.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119099154, 'registration': 'FN72LJA', 'account': 'RCI014', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 150 Prestige 5dr EDC', 'mileage': 21081, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 19K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/08787cb7-243b-42dc-8ba1-ca04bffe1366.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b401f480-6f88-5639-b764-38b3f137f1fb with identifier: 119099154
2026-01-28 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b401f480-6f88-5639-b764-38b3f137f1fb with scrape type 1
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b401f480-6f88-5639-b764-38b3f137f1fb
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b401f480-6f88-5639-b764-38b3f137f1fb
2026-01-28 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b401f480-6f88-5639-b764-38b3f137f1fb, identifier: 119099154
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252Ff899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b401f480-6f88-5639-b764-38b3f137f1fb with identifier: 119099154
2026-01-28 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b401f480-6f88-5639-b764-38b3f137f1fb with identifier: 119099154
2026-01-28 19:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b401f480-6f88-5639-b764-38b3f137f1fb with identifier: 119099154 to the API
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b401f480-6f88-5639-b764-38b3f137f1fb%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b401f480-6f88-5639-b764-38b3f137f1fb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:03:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119099154?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'ORANGE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b401f480-6f88-5639-b764-38b3f137f1fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'FN72LJA',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119099154',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'DACIA',
'model': 'DUSTER ESTATE',
'odometer': 21081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-01',
'seller_name': None,
'title': 'DACIA DUSTER ESTATE 1.3 TCe 150 Prestige 5dr EDC',
'transmission': 'automatic',
'trim': '1.3 TCe 150 Prestige 5dr EDC',
'vin': None,
'year': 2022}
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099154%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [astonbarclay.gb] INFO: Saving data for 119099154: {'created_time': 1769627018.654687, 'last_price_update_time': 1769627018.654697}
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119099154') HTTP/1.1" 204 0
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060933?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Fccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191899cd0>
2026-01-28 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c18d0>
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252Ffec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319030c990>
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252F36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009d8d0>
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252Fb8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190632f10>
2026-01-28 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009d910>
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252Fc2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a9490>
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190140290>
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:03:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119075275, 'registration': 'HT17RXA', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 110 Dynamique Nav 5dr', 'mileage': 95337, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-06-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 39K 44K 48K 50K 67K 83K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/081ff348-30cb-4827-a7de-e8d50bd4c1a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119075275, 'registration': 'HT17RXA', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 110 Dynamique Nav 5dr', 'mileage': 95337, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-06-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 39K 44K 48K 50K 67K 83K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/081ff348-30cb-4827-a7de-e8d50bd4c1a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00fe42f0-22da-5d7b-8377-73854c29779d with identifier: 119075275
2026-01-28 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00fe42f0-22da-5d7b-8377-73854c29779d with scrape type 1
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F031e13be-d692-4928-8054-60e235521028_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119102626, 'registration': 'YN16TXV', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'GRAND C4 PICASSO DIESEL ESTATE', 'derivative': '2.0 BlueHDi Exclusive+ 5dr', 'mileage': 81103, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2016-03-15', 'fuel': 'Diesel', 'motExpiry': '2027-01-06', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 9/22 59K, 8/23 65K, 2/24 70K,', 'remarks': 'VOSA STATES 59K, 66K, 74K, 81K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bde8be92-fa74-47e4-8dc3-c8fc27b43147.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119102626, 'registration': 'YN16TXV', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'GRAND C4 PICASSO DIESEL ESTATE', 'derivative': '2.0 BlueHDi Exclusive+ 5dr', 'mileage': 81103, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2016-03-15', 'fuel': 'Diesel', 'motExpiry': '2027-01-06', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 9/22 59K, 8/23 65K, 2/24 70K,', 'remarks': 'VOSA STATES 59K, 66K, 74K, 81K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bde8be92-fa74-47e4-8dc3-c8fc27b43147.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85d17d1-4ae9-583f-a451-8d8cc6516cba with identifier: 119102626
2026-01-28 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85d17d1-4ae9-583f-a451-8d8cc6516cba with scrape type 1
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e85d17d1-4ae9-583f-a451-8d8cc6516cba
2026-01-28 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e85d17d1-4ae9-583f-a451-8d8cc6516cba
2026-01-28 19:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e85d17d1-4ae9-583f-a451-8d8cc6516cba, identifier: 119102626
2026-01-28 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e85d17d1-4ae9-583f-a451-8d8cc6516cba with identifier: 119102626
2026-01-28 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e85d17d1-4ae9-583f-a451-8d8cc6516cba with identifier: 119102626
2026-01-28 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: e85d17d1-4ae9-583f-a451-8d8cc6516cba spider: astonbarclay.gb
2026-01-28 19:03:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e85d17d1-4ae9-583f-a451-8d8cc6516cba due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': None,
'fuel_type': 'Diesel',
'id': 'e85d17d1-4ae9-583f-a451-8d8cc6516cba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YN16TXV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119102626',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'CITROEN',
'model': 'GRAND C4 PICASSO DIESEL ESTATE',
'odometer': 81103,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seller_name': 'Manamanx Ltd',
'title': 'CITROEN GRAND C4 PICASSO DIESEL ESTATE 2.0 BlueHDi Exclusive+ 5dr',
'transmission': 'manual',
'trim': '2.0 BlueHDi Exclusive+ 5dr',
'vin': None,
'year': 2016}
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119102626%27 HTTP/1.1" 200 None
2026-01-28 19:03:41 [astonbarclay.gb] INFO: Saving data for 119102626: {'created_time': 1769627021.247663, 'last_price_update_time': 1769627021.247676}
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119102626') HTTP/1.1" 204 0
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252Ffdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319013fb90>
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919eab90>
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837b9390>
2026-01-28 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg HTTP/1.1" 201 0
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB67CBU%252F2026-01-28%252Fimage%252F92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 181a8653-7cbf-555f-abb0-d617f8adbb48
2026-01-28 19:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 181a8653-7cbf-555f-abb0-d617f8adbb48, skipping ID generation
2026-01-28 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181a8653-7cbf-555f-abb0-d617f8adbb48 with scrape type 1
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 181a8653-7cbf-555f-abb0-d617f8adbb48 from tracking dictionaries
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 181a8653-7cbf-555f-abb0-d617f8adbb48 sending to next pipeline
2026-01-28 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 181a8653-7cbf-555f-abb0-d617f8adbb48, identifier: 119060933
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319036f610>
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190115e90>
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904b5690>
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Facabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902c40d0>
2026-01-28 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190117210>
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fb3617715-8175-4627-8bc2-932847c92d67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 181a8653-7cbf-555f-abb0-d617f8adbb48 with identifier: 119060933
2026-01-28 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 181a8653-7cbf-555f-abb0-d617f8adbb48 with identifier: 119060933
2026-01-28 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 12, 'seller_name': 'ukcgr', 'price_includes_vat': False, 'title': 'bmw x1 diesel estate sdrive 18d xline 5dr step auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x1 diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 166135, 'odometer_reading_unit': 'mi', 'registration_date': '2017-12-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060933', 'expiration_date': None, 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'sdrive 18d xline 5dr step auto', 'license_plate': 'lb67cbu', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 114, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '181a8653-7cbf-555f-abb0-d617f8adbb48', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 23635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 37549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 38911}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41696}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 50883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42748}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41881}], 'current_year_diff': 9, 'age_in_months': 96, 'make_model': 'bmw x1 diesel estate', 'sanitized_make': 'bmw', 'odometer_in_km': 267367}
Failed validating None in schema:
False
On instance:
{'age_in_months': 96,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': None,
'fuel_type': 'diesel',
'id': '181a8653-7cbf-555f-abb0-d617f8adbb48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lb67cbu',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060933',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'bmw',
'make_model': 'bmw x1 diesel estate',
'model': 'x1 diesel estate',
'odometer': 166135,
'odometer_in_km': 267367,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25663,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24272,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21867,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23635,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37549,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38911,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41696,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43026,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50883,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40646,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42748,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41881,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-29',
'sanitized_make': 'bmw',
'seller_name': 'ukcgr',
'title': 'bmw x1 diesel estate sdrive 18d xline 5dr step auto',
'transmission': 'automatic',
'trim': 'sdrive 18d xline 5dr step auto',
'vin': None,
'year': 2017}
2026-01-28 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 181a8653-7cbf-555f-abb0-d617f8adbb48 spider: astonbarclay.gb
2026-01-28 19:03:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 181a8653-7cbf-555f-abb0-d617f8adbb48 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 12, 'seller_name': 'ukcgr', 'price_includes_vat': False, 'title': 'bmw x1 diesel estate sdrive 18d xline 5dr step auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x1 diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 166135, 'odometer_reading_unit': 'mi', 'registration_date': '2017-12-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060933', 'expiration_date': None, 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'sdrive 18d xline 5dr step auto', 'license_plate': 'lb67cbu', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 114, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '181a8653-7cbf-555f-abb0-d617f8adbb48', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 23635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 37549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 38911}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41696}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 50883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42748}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41881}], 'current_year_diff': 9, 'age_in_months': 96, 'make_model': 'bmw x1 diesel estate', 'sanitized_make': 'bmw', 'odometer_in_km': 267367}
Failed validating None in schema:
False
On instance:
{'age_in_months': 96,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': None,
'fuel_type': 'diesel',
'id': '181a8653-7cbf-555f-abb0-d617f8adbb48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lb67cbu',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060933',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'bmw',
'make_model': 'bmw x1 diesel estate',
'model': 'x1 diesel estate',
'odometer': 166135,
'odometer_in_km': 267367,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25663,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24272,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21867,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23635,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37549,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38911,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41696,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43026,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50883,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40646,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42748,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41881,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-29',
'sanitized_make': 'bmw',
'seller_name': 'ukcgr',
'title': 'bmw x1 diesel estate sdrive 18d xline 5dr step auto',
'transmission': 'automatic',
'trim': 'sdrive 18d xline 5dr step auto',
'vin': None,
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '181a8653-7cbf-555f-abb0-d617f8adbb48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LB67CBU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060933',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': 'X1 DIESEL ESTATE',
'odometer': 166135,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25663,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4fb4b61d-dce5-49b7-81df-c3c972dbe712_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24272,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9d5a79c8-f77b-478d-9f51-bd5818a93723_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21867,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/c408badc-ba2b-4b12-a2ec-1c6b573d4c96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23635,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/9085b816-1b3b-44c4-b773-2874f506f12a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37549,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/30c5663b-2bfa-4e84-bc62-45631b37b75f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38911,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/ddbaeb07-dc3b-453c-9458-e6c50b601414_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41696,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/4e6ce100-229d-4827-ab2f-cbaf84743eaa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43026,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b864aa9a-3ddb-450d-8d30-25435bf1f7c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50883,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/24a768e5-a0d7-4306-952b-e829873335f0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40646,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/b8b6150b-9b73-46ce-90d8-b757188e7df9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42748,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/8d2d5f4d-cd80-4ddb-96b1-ffd6f10413d1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a8653-7cbf-555f-abb0-d617f8adbb48/181a8653-7cbf-555f-abb0-d617f8adbb48_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41881,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/LB67CBU/2026-01-28/image/92275a8b-d171-45cb-87c2-d27d8ca4a75c_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-29',
'seller_name': 'UKCGR',
'title': 'BMW X1 DIESEL ESTATE sDrive 18d xLine 5dr Step Auto',
'transmission': 'automatic',
'trim': 'sDrive 18d xLine 5dr Step Auto',
'vin': None,
'year': 2017}
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060933%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [astonbarclay.gb] INFO: Saving data for 119060933: {'created_time': 1769627023.589203, 'last_price_update_time': 1769627023.589213}
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119060933') HTTP/1.1" 204 0
2026-01-28 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119096859, 'registration': 'DE72XNT', 'account': 'MOT070', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI e-TEC SE Technology 5dr DSG', 'mileage': 3546, 'mileageWarranty': True, 'type': 'car', 'saleId': 18354, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-10T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'ADAPTIONS REMOVED - HOIST - vosa - 3k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aff263d-b528-46f6-b9fb-96ac60f3b1ac.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119096859, 'registration': 'DE72XNT', 'account': 'MOT070', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI e-TEC SE Technology 5dr DSG', 'mileage': 3546, 'mileageWarranty': True, 'type': 'car', 'saleId': 18354, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-10T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'ADAPTIONS REMOVED - HOIST - vosa - 3k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aff263d-b528-46f6-b9fb-96ac60f3b1ac.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0102dbe-06cd-5b75-8279-711946c51cda with identifier: 119096859
2026-01-28 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0102dbe-06cd-5b75-8279-711946c51cda with scrape type 1
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190263610>
2026-01-28 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252Ff1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118687613?view=catalogue)
2026-01-28 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fb2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903be090>
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Fb14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319040f290>
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190204bd0>
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190205590>
2026-01-28 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190331dd0>
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252Fa8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190333890>
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3193156190>
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191909450>
2026-01-28 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252Ff899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118263462?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190321290>
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190207050>
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK72GKZ%252F2026-01-16%252Fimage%252F3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb
2026-01-28 19:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb, skipping ID generation
2026-01-28 19:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb with scrape type 1
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb from tracking dictionaries
2026-01-28 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0db90314-23f0-5054-bcaa-f9e59cf4e5cb sending to next pipeline
2026-01-28 19:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb, identifier: 118687613
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183720590>
2026-01-28 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb with identifier: 118687613
2026-01-28 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb with identifier: 118687613
2026-01-28 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 21017, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118687613', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'vk72gkz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0db90314-23f0-5054-bcaa-f9e59cf4e5cb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32338}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30046}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29356}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52029}], 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 33823} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 38,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '0db90314-23f0-5054-bcaa-f9e59cf4e5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'vk72gkz',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118687613',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 21017,
'odometer_in_km': 33823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31839,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32338,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32482,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30046,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29356,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60033,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50397,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52029,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'sanitized_make': 'volkswagen',
'seller_name': 'kinto',
'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
'transmission': 'automatic',
'trim': '109kw life pure 52kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb spider: astonbarclay.gb
2026-01-28 19:03:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0db90314-23f0-5054-bcaa-f9e59cf4e5cb due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 21017, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118687613', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'vk72gkz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0db90314-23f0-5054-bcaa-f9e59cf4e5cb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32338}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30046}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29356}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52029}], 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 33823} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 38,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '0db90314-23f0-5054-bcaa-f9e59cf4e5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'vk72gkz',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118687613',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 21017,
'odometer_in_km': 33823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31839,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32338,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32482,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30046,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29356,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60033,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50397,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52029,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'sanitized_make': 'volkswagen',
'seller_name': 'kinto',
'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
'transmission': 'automatic',
'trim': '109kw life pure 52kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Electric',
'id': '0db90314-23f0-5054-bcaa-f9e59cf4e5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VK72GKZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118687613',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 21017,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31839,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/e2277859-1503-44f6-a216-2b0fed728630_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32338,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9de7db2c-faea-4c55-b598-d4d6aed96027_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32482,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/ebbdb556-2a72-4143-ae04-945f2b3037dc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30046,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/3b52ed55-281d-4b7b-acea-fc471e1c2c4a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29356,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/1a4bb3d5-c2d7-49e0-ad4b-25b8b02d3977_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60033,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/9baf355f-3db5-4206-8303-28695d66d07f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50397,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/c9a081b1-0b42-4a0e-bb76-68b788c3fb0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/44318bb0-3785-4d28-8bb7-d1aff06e8909_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db90314-23f0-5054-bcaa-f9e59cf4e5cb/0db90314-23f0-5054-bcaa-f9e59cf4e5cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52029,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/VK72GKZ/2026-01-16/image/7b627bcf-0f15-4a53-8680-86bc48d2b858_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'seller_name': 'Kinto',
'title': 'VOLKSWAGEN ID.4 ESTATE 109kW Life Pure 52kWh 5dr Auto',
'transmission': 'automatic',
'trim': '109kW Life Pure 52kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118687613%27 HTTP/1.1" 200 None
2026-01-28 19:03:47 [astonbarclay.gb] INFO: Saving data for 118687613: {'created_time': 1769627027.436971, 'last_price_update_time': 1769627027.436983, 'auction_closing_time': 1770371100.0}
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118687613') HTTP/1.1" 204 0
2026-01-28 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190272c10>
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190370950>
2026-01-28 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183766190>
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837ac5d0>
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252Fccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837ac150>
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252F9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837afad0>
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F031e13be-d692-4928-8054-60e235521028_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190140f10>
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319030f950>
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118263462, 'registration': 'GU25LCK', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 9654, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU25LCK/2026-01-07/image/d3510168-0361-4b89-9623-bdfb97ea2af4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/3af94daa-b56d-4d0b-bd8a-ab996b8e6eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/7b727e9c-4c0c-4a19-bf47-da0c0d165e17_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/6e16e07f-fe3e-4645-a114-2ce98522158b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/4e202f6f-4c71-4e6c-a499-f22dc84bc2c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/82fc18b6-e977-40f3-b9dd-a178f1752d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/9ca98789-2bee-4719-b254-40a5fea80e1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/7ba17383-77d0-49c2-b090-f5be76ca4cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/f0b27cfd-1d89-4f72-84af-6d5dd7789e8d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37d92fba-8026-4aef-a757-ce719db875b0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118263462, 'registration': 'GU25LCK', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 9654, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU25LCK/2026-01-07/image/d3510168-0361-4b89-9623-bdfb97ea2af4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/3af94daa-b56d-4d0b-bd8a-ab996b8e6eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/7b727e9c-4c0c-4a19-bf47-da0c0d165e17_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/6e16e07f-fe3e-4645-a114-2ce98522158b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/4e202f6f-4c71-4e6c-a499-f22dc84bc2c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/82fc18b6-e977-40f3-b9dd-a178f1752d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/9ca98789-2bee-4719-b254-40a5fea80e1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/7ba17383-77d0-49c2-b090-f5be76ca4cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU25LCK/2026-01-07/image/f0b27cfd-1d89-4f72-84af-6d5dd7789e8d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37d92fba-8026-4aef-a757-ce719db875b0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602efb06-a0b4-51c3-b124-a702c3e908ab with identifier: 118263462
2026-01-28 19:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602efb06-a0b4-51c3-b124-a702c3e908ab with scrape type 2
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 602efb06-a0b4-51c3-b124-a702c3e908ab with scrape type 2
2026-01-28 19:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 602efb06-a0b4-51c3-b124-a702c3e908ab, identifier: 118263462
2026-01-28 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 602efb06-a0b4-51c3-b124-a702c3e908ab with identifier: 118263462
2026-01-28 19:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 602efb06-a0b4-51c3-b124-a702c3e908ab with identifier: 118263462
2026-01-28 19:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 602efb06-a0b4-51c3-b124-a702c3e908ab with identifier: 118263462 to the API
2026-01-28 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118263462?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': '602efb06-a0b4-51c3-b124-a702c3e908ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GU25LCK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118263462',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FIAT',
'model': '600 HATCHBACK',
'odometer': 9654,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-11',
'seller_name': 'Motability Operations',
'title': 'FIAT 600 HATCHBACK 1.2 Hybrid 48V 5dr eDCT-6',
'transmission': 'automatic',
'trim': '1.2 Hybrid 48V 5dr eDCT-6',
'vin': None,
'year': 2025}
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118263462%27 HTTP/1.1" 200 None
2026-01-28 19:03:50 [astonbarclay.gb] INFO: Saving data for 118263462: {'auction_closing_time': 1770631200.0, 'created_time': 1768331670.03859, 'last_price_update_time': 1769627030.603036}
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118263462') HTTP/1.1" 204 0
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190cf92d0>
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191672ed0>
2026-01-28 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191ad2650>
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190160990>
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252Ffdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31930172d0>
2026-01-28 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252Ff1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319016b490>
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319016b450>
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190326a90>
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905254d0>
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837f19d0>
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318361fb50>
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009c2d0>
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fb2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904e74d0>
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900be990>
2026-01-28 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190275f90>
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183787fd0>
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060536?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119064671?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119060782?view=catalogue)
2026-01-28 19:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916b5850>
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902f01d0>
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028d250>
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319186b710>
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRJ20KKR%252F2026-01-28%252Fimage%252F43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4
2026-01-28 19:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3cdbf8b-1732-5d99-bac9-64014eeffdc4, skipping ID generation
2026-01-28 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with scrape type 1
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b3cdbf8b-1732-5d99-bac9-64014eeffdc4 from tracking dictionaries
2026-01-28 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3cdbf8b-1732-5d99-bac9-64014eeffdc4 sending to next pipeline
2026-01-28 19:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b3cdbf8b-1732-5d99-bac9-64014eeffdc4, identifier: 119060536
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319195dc50>
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE68AWW%252F2026-01-28%252Fimage%252F62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fd345fa4-483b-5805-8fbb-be6be373359f
2026-01-28 19:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd345fa4-483b-5805-8fbb-be6be373359f, skipping ID generation
2026-01-28 19:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd345fa4-483b-5805-8fbb-be6be373359f with scrape type 1
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fd345fa4-483b-5805-8fbb-be6be373359f from tracking dictionaries
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd345fa4-483b-5805-8fbb-be6be373359f sending to next pipeline
2026-01-28 19:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fd345fa4-483b-5805-8fbb-be6be373359f, identifier: 119064671
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191929ad0>
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190104850>
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190208f50>
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFY21AUL%252F2026-01-28%252Fimage%252F6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eda265a0-230d-59e5-af26-f5a66aad8440
2026-01-28 19:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eda265a0-230d-59e5-af26-f5a66aad8440, skipping ID generation
2026-01-28 19:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eda265a0-230d-59e5-af26-f5a66aad8440 with scrape type 1
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eda265a0-230d-59e5-af26-f5a66aad8440 from tracking dictionaries
2026-01-28 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eda265a0-230d-59e5-af26-f5a66aad8440 sending to next pipeline
2026-01-28 19:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eda265a0-230d-59e5-af26-f5a66aad8440, identifier: 119060782
2026-01-28 19:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with identifier: 119060536
2026-01-28 19:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with identifier: 119060536
2026-01-28 19:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b3cdbf8b-1732-5d99-bac9-64014eeffdc4 with identifier: 119060536 to the API
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'b3cdbf8b-1732-5d99-bac9-64014eeffdc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RJ20KKR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060536',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'PUMA HATCHBACK',
'odometer': 31879,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38015,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/08e778c9-7c8f-4b87-8a51-0093d086a986_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40667,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7bbd9481-210d-4e4d-80db-3d2f00ef978c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38643,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/a8f11117-f23c-47ac-befa-5e5b3ed3f7e1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40122,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/9de7e8a2-4972-4565-8732-f3b2a12b822e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58000,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/7f417043-0176-4380-9dc2-68d31e99b65f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58081,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/fdecfab2-ccca-44d3-b438-861ec0a95469_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42594,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43d5b060-04c2-4c75-bb24-d841fd314f74_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56754,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/0308d707-6f6d-4a7b-bd6c-78f0d00fd6d3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cdbf8b-1732-5d99-bac9-64014eeffdc4/b3cdbf8b-1732-5d99-bac9-64014eeffdc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55673,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/RJ20KKR/2026-01-28/image/43c0b622-ddc2-40f6-b6ca-6041ee30cfbe_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seller_name': 'UKCGR',
'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060536%27 HTTP/1.1" 200 None
2026-01-28 19:03:57 [astonbarclay.gb] INFO: Saving data for 119060536: {'created_time': 1769627037.748008, 'last_price_update_time': 1769627037.748018}
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119060536') HTTP/1.1" 204 0
2026-01-28 19:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fd345fa4-483b-5805-8fbb-be6be373359f with identifier: 119064671
2026-01-28 19:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fd345fa4-483b-5805-8fbb-be6be373359f with identifier: 119064671
2026-01-28 19:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fd345fa4-483b-5805-8fbb-be6be373359f with identifier: 119064671 to the API
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'fd345fa4-483b-5805-8fbb-be6be373359f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RE68AWW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119064671',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MINI',
'model': 'COUNTRYMAN HATCHBACK',
'odometer': 62514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25890,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/0540f643-4cd7-4d49-84cb-3a7e4a443c43_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25939,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/acabf5fd-914f-4c24-8eeb-c362233eee96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24738,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/20ef4d88-9c63-4f4d-bdfb-90b925e021ed_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24803,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/b14598ad-7a85-47dc-b651-d07951fc2ed8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54528,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/2bc4039f-68a7-4252-8f35-1d1c2162f25e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55500,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/ccc87438-6700-476a-81b2-63b19ef3cb47_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41676,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/11e55104-2f81-49ea-886f-8a4f7611ded4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51455,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/09137e7d-3915-4cd3-b86c-0e4364f9595f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41672,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/9a120f80-342d-44b9-97e6-7a8d491564a2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44209,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/23af6af1-5624-4a74-9dfa-3ee2965fc1ab_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd345fa4-483b-5805-8fbb-be6be373359f/fd345fa4-483b-5805-8fbb-be6be373359f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45204,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/RE68AWW/2026-01-28/image/62142bd7-c137-41f3-80e6-b935fc6fafef_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-27',
'seller_name': 'UKCGR',
'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper 5dr',
'transmission': 'manual',
'trim': '1.5 Cooper 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119064671%27 HTTP/1.1" 200 None
2026-01-28 19:03:58 [astonbarclay.gb] INFO: Saving data for 119064671: {'created_time': 1769627038.100212, 'last_price_update_time': 1769627038.100225}
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119064671') HTTP/1.1" 204 0
2026-01-28 19:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eda265a0-230d-59e5-af26-f5a66aad8440 with identifier: 119060782
2026-01-28 19:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eda265a0-230d-59e5-af26-f5a66aad8440 with identifier: 119060782
2026-01-28 19:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eda265a0-230d-59e5-af26-f5a66aad8440 with identifier: 119060782 to the API
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': None,
'fuel_type': 'Petrol',
'id': 'eda265a0-230d-59e5-af26-f5a66aad8440',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FY21AUL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119060782',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 44541,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26899,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/4ab1fc52-4f76-4198-901e-27aaab7fb18d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25079,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/2a28d200-c64e-4c6f-8f8f-6688772d9575_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25581,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/3b26064e-e5a6-4b9b-9ba2-8a5b1b345dd3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23788,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/f899ffd6-f4c9-4577-bb52-b538e0e85f03_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39099,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/0484e2ad-5468-4228-80cf-787342dc11c5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47840,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/24fc33a9-66a0-4adb-8ef7-824aff5e82a6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41832,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/6e1e11d7-ae3d-47c3-98a0-e0e1afdbe4ff_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49547,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/9dac3d6f-72cf-4f02-94bf-a18a432bd4d5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda265a0-230d-59e5-af26-f5a66aad8440/eda265a0-230d-59e5-af26-f5a66aad8440_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47805,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/FY21AUL/2026-01-28/image/278e571c-94a1-4d6e-85c4-c35579be4202_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seller_name': 'UKCGR',
'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T Tekna 5dr DCT',
'transmission': 'automatic',
'trim': '1.0 DiG-T Tekna 5dr DCT',
'vin': None,
'year': 2021}
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119060782%27 HTTP/1.1" 200 None
2026-01-28 19:03:58 [astonbarclay.gb] INFO: Saving data for 119060782: {'created_time': 1769627038.462093, 'last_price_update_time': 1769627038.462104}
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119060782') HTTP/1.1" 204 0
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119075275?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118750135?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119096859?view=catalogue)
2026-01-28 19:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904daa10>
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT17RXA%252F2026-01-28%252Fimage%252F1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00fe42f0-22da-5d7b-8377-73854c29779d
2026-01-28 19:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00fe42f0-22da-5d7b-8377-73854c29779d, skipping ID generation
2026-01-28 19:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00fe42f0-22da-5d7b-8377-73854c29779d with scrape type 1
2026-01-28 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00fe42f0-22da-5d7b-8377-73854c29779d from tracking dictionaries
2026-01-28 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00fe42f0-22da-5d7b-8377-73854c29779d sending to next pipeline
2026-01-28 19:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 00fe42f0-22da-5d7b-8377-73854c29779d, identifier: 119075275
2026-01-28 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118317404?view=catalogue)
2026-01-28 19:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 00fe42f0-22da-5d7b-8377-73854c29779d with identifier: 119075275
2026-01-28 19:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 00fe42f0-22da-5d7b-8377-73854c29779d with identifier: 119075275
2026-01-28 19:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153429 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153429
2026-01-28 19:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 00fe42f0-22da-5d7b-8377-73854c29779d spider: astonbarclay.gb
2026-01-28 19:03:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 00fe42f0-22da-5d7b-8377-73854c29779d due to rule: high_mileage_for_country.json, error: 153429 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153429
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': None,
'fuel_type': 'Diesel',
'id': '00fe42f0-22da-5d7b-8377-73854c29779d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'HT17RXA',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119075275',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'RENAULT',
'model': 'CAPTUR DIESEL HATCHBACK',
'odometer': 95337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28170,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/031e13be-d692-4928-8054-60e235521028_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28948,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/56dd94ec-9cb6-47df-98d8-bc437776935c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23615,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/42d0abca-0a06-4a8e-a16a-3796dc3f3532_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23703,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/f1b3d5e4-1896-47f6-b92b-297b621c8047_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51234,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/57228aba-4788-4d3d-8072-8d5a6d5e502b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40529,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/41f4300e-7186-497e-a9e3-5edb8d02c66b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48529,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/81f03f6b-7a01-4c6a-95fd-367b711abf97_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00fe42f0-22da-5d7b-8377-73854c29779d/00fe42f0-22da-5d7b-8377-73854c29779d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48096,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HT17RXA/2026-01-28/image/1a494fcd-d2cc-48a4-be1b-0a2d8330d72a_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-27',
'seller_name': None,
'title': 'RENAULT CAPTUR DIESEL HATCHBACK 1.5 dCi 110 Dynamique Nav 5dr',
'transmission': 'manual',
'trim': '1.5 dCi 110 Dynamique Nav 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119075275%27 HTTP/1.1" 200 None
2026-01-28 19:03:59 [astonbarclay.gb] INFO: Saving data for 119075275: {'created_time': 1769627039.095484, 'last_price_update_time': 1769627039.095494}
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119075275') HTTP/1.1" 204 0
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118953753?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118735717?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009c590>
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHV%252F2026-01-20%252Fimage%252F1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1
2026-01-28 19:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1, skipping ID generation
2026-01-28 19:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 with scrape type 1
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 from tracking dictionaries
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 sending to next pipeline
2026-01-28 19:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1, identifier: 118750135
2026-01-28 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183613390>
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252F86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600 saved to cache
2026-01-28 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183670e50>
2026-01-28 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183610350>
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fb3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183737690>
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916b2e10>
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190633610>
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE72XNT%252F2026-01-28%252Fimage%252Fce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0102dbe-06cd-5b75-8279-711946c51cda
2026-01-28 19:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0102dbe-06cd-5b75-8279-711946c51cda, skipping ID generation
2026-01-28 19:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0102dbe-06cd-5b75-8279-711946c51cda with scrape type 1
2026-01-28 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a0102dbe-06cd-5b75-8279-711946c51cda from tracking dictionaries
2026-01-28 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0102dbe-06cd-5b75-8279-711946c51cda sending to next pipeline
2026-01-28 19:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a0102dbe-06cd-5b75-8279-711946c51cda, identifier: 119096859
2026-01-28 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 with identifier: 118750135
2026-01-28 19:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 with identifier: 118750135
2026-01-28 19:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28792, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118750135', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhv', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '00dcbea1-26df-5828-a96a-2a02d3a1e8f1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25841}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 50300}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42225}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43707}], 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 46336} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '00dcbea1-26df-5828-a96a-2a02d3a1e8f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vhv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118750135',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 28792,
'odometer_in_km': 46336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26373,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25214,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25671,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25841,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43642,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50300,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42280,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42225,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43707,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 spider: astonbarclay.gb
2026-01-28 19:04:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 00dcbea1-26df-5828-a96a-2a02d3a1e8f1 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28792, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118750135', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhv', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '00dcbea1-26df-5828-a96a-2a02d3a1e8f1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25841}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 50300}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 42225}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43707}], 'current_year_diff': 4, 'age_in_months': 40, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 46336} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '00dcbea1-26df-5828-a96a-2a02d3a1e8f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'gu72vhv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118750135',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqc estate',
'model': 'eqc estate',
'odometer': 28792,
'odometer_in_km': 46336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26373,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25214,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25671,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25841,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43642,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50300,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42280,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42225,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43707,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'sanitized_make': 'mercedesbenz',
'seller_name': 'kinto',
'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Electric',
'id': '00dcbea1-26df-5828-a96a-2a02d3a1e8f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GU72VHV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118750135',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MERCEDES-BENZ',
'model': 'EQC ESTATE',
'odometer': 28792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26373,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/2f3cd381-f654-4462-b04c-3a465d84cebb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25214,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/1f15d906-4a53-4c20-99df-b2a630f6c652_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25671,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/7343591a-105b-400f-8811-8803be7149ac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25841,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/5adaacd7-557f-4a4a-b6f9-c1bd66028655_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43642,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/ac619ad3-2aa3-4ab7-b994-51bc525a333a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50300,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/c5761a73-fd78-4650-9a57-8d5fa7c7468f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42280,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/9ffa6226-d77c-4204-b2cc-76564de18ec0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42225,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/6519c77e-e8fb-4483-a8c1-cb8715135100_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dcbea1-26df-5828-a96a-2a02d3a1e8f1/00dcbea1-26df-5828-a96a-2a02d3a1e8f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43707,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/GU72VHV/2026-01-20/image/aa528225-daa8-4e2b-8ab3-7fcb5d169449_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'seller_name': 'Kinto',
'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
'transmission': 'automatic',
'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118750135%27 HTTP/1.1" 200 None
2026-01-28 19:04:01 [astonbarclay.gb] INFO: Saving data for 118750135: {'created_time': 1769627041.360528, 'last_price_update_time': 1769627041.360539, 'auction_closing_time': 1770371100.0}
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118750135') HTTP/1.1" 204 0
2026-01-28 19:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a0102dbe-06cd-5b75-8279-711946c51cda with identifier: 119096859
2026-01-28 19:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a0102dbe-06cd-5b75-8279-711946c51cda with identifier: 119096859
2026-01-28 19:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a0102dbe-06cd-5b75-8279-711946c51cda with identifier: 119096859 to the API
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-10T10:15:00Z',
'fuel_type': 'Petrol',
'id': 'a0102dbe-06cd-5b75-8279-711946c51cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DE72XNT',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119096859',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'SKODA',
'model': 'OCTAVIA ESTATE',
'odometer': 3546,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36401,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/27e00a6d-2c40-4ced-b384-384e87edb6f4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37471,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/2379c2d8-14da-47c9-b26d-b7a1290419c6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37004,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/b2b52bb2-2bb8-4d2a-b357-a78d20bc5405_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37241,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/49a8b08e-4502-4822-b778-aa07c19dcdd4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38743,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce4b5f48-9c55-4548-b797-18453f6b596b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57551,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/5b61d90f-9d01-496c-99b1-677cbb15b622_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68844,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/ce30fe9a-688b-4dd3-924f-ceb41b60961c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0102dbe-06cd-5b75-8279-711946c51cda/a0102dbe-06cd-5b75-8279-711946c51cda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55244,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DE72XNT/2026-01-28/image/86584152-9f83-412d-8a26-bdedcd15127b_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-17',
'seller_name': 'Motability Operations',
'title': 'SKODA OCTAVIA ESTATE 1.0 TSI e-TEC SE Technology 5dr DSG',
'transmission': 'automatic',
'trim': '1.0 TSI e-TEC SE Technology 5dr DSG',
'vin': None,
'year': 2022}
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119096859%27 HTTP/1.1" 200 None
2026-01-28 19:04:01 [astonbarclay.gb] INFO: Saving data for 119096859: {'created_time': 1769627041.745287, 'last_price_update_time': 1769627041.745298, 'auction_closing_time': 1770718500.0}
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119096859') HTTP/1.1" 204 0
2026-01-28 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118741136?view=catalogue)
2026-01-28 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028b310>
2026-01-28 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV72UDP%252F2026-01-28%252Fimage%252Fc5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ef489e5-275f-5a12-bf10-beae35721514
2026-01-28 19:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ef489e5-275f-5a12-bf10-beae35721514, skipping ID generation
2026-01-28 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef489e5-275f-5a12-bf10-beae35721514 with scrape type 1
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ef489e5-275f-5a12-bf10-beae35721514 from tracking dictionaries
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ef489e5-275f-5a12-bf10-beae35721514 sending to next pipeline
2026-01-28 19:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ef489e5-275f-5a12-bf10-beae35721514, identifier: 118317404
2026-01-28 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118694625?view=catalogue)
2026-01-28 19:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118159423?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ef489e5-275f-5a12-bf10-beae35721514 with identifier: 118317404
2026-01-28 19:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ef489e5-275f-5a12-bf10-beae35721514 with identifier: 118317404
2026-01-28 19:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 13, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 250kw edrive40 m sport 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60931, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118317404', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '250kw edrive40 m sport 83.9kwh 5dr auto', 'license_plate': 'hv72udp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7ef489e5-275f-5a12-bf10-beae35721514', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38455}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42767}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59382}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58405}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55892}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50906}], 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 98058} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '7ef489e5-275f-5a12-bf10-beae35721514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'hv72udp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118317404',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'bmw',
'make_model': 'bmw i4 gran coupe',
'model': 'i4 gran coupe',
'odometer': 60931,
'odometer_in_km': 98058,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35129,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32317,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33330,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38455,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42767,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41722,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59382,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57116,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58405,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55892,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42064,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50906,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'sanitized_make': 'bmw',
'seller_name': 'days fleet',
'title': 'bmw i4 gran coupe 250kw edrive40 m sport 83.9kwh 5dr auto',
'transmission': 'automatic',
'trim': '250kw edrive40 m sport 83.9kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 7ef489e5-275f-5a12-bf10-beae35721514 spider: astonbarclay.gb
2026-01-28 19:04:02 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7ef489e5-275f-5a12-bf10-beae35721514 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 13, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 250kw edrive40 m sport 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60931, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118317404', 'expiration_date': '2026-02-06t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '250kw edrive40 m sport 83.9kwh 5dr auto', 'license_plate': 'hv72udp', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7ef489e5-275f-5a12-bf10-beae35721514', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38455}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42767}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59382}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58405}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55892}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50906}], 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 98058} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-06t09:45:00z',
'fuel_type': 'electric',
'id': '7ef489e5-275f-5a12-bf10-beae35721514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'hv72udp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118317404',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'bmw',
'make_model': 'bmw i4 gran coupe',
'model': 'i4 gran coupe',
'odometer': 60931,
'odometer_in_km': 98058,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35129,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32317,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33330,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38455,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42767,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41722,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59382,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57116,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58405,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55892,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42064,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50906,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'sanitized_make': 'bmw',
'seller_name': 'days fleet',
'title': 'bmw i4 gran coupe 250kw edrive40 m sport 83.9kwh 5dr auto',
'transmission': 'automatic',
'trim': '250kw edrive40 m sport 83.9kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Electric',
'id': '7ef489e5-275f-5a12-bf10-beae35721514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'HV72UDP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118317404',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': 'I4 GRAN COUPE',
'odometer': 60931,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35129,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/682867c9-3725-415d-b728-59e532d4f087_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32317,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/c5251a4d-5390-4eb9-b9be-5959127b4a13_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33330,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/53b43c22-1271-483f-a3d1-c06f4f26750e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/ac4bcd65-6a17-43c1-8c38-a6b5735128de_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38455,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8878df9a-5504-48d5-8dc9-c1c1be31a8c8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42767,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8ee736e2-3c4a-42b2-9dad-1b028a601770_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41722,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/8762ad36-4200-423e-9e39-681e26ebf917_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59382,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/36442bc9-8e36-4782-a52b-59789ca9caa6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57116,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/bf6a07f7-8492-4091-b3dc-ded9cefd6cab_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58405,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/75db1c7e-cbd7-4d9d-ae6f-377717a8b47c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55892,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/2a9a208c-feb4-4d98-885f-0c6a8762b8df_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42064,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/79dd5e11-0615-4792-b377-27cf1a4288c4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef489e5-275f-5a12-bf10-beae35721514/7ef489e5-275f-5a12-bf10-beae35721514_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50906,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV72UDP/2026-01-28/image/da84dc79-2d6a-41f9-8e9c-965f8d39da9d_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'seller_name': 'Days Fleet',
'title': 'BMW I4 GRAN COUPE 250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'transmission': 'automatic',
'trim': '250kW eDrive40 M Sport 83.9kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118317404%27 HTTP/1.1" 200 None
2026-01-28 19:04:02 [astonbarclay.gb] INFO: Saving data for 118317404: {'created_time': 1769627042.532241, 'last_price_update_time': 1769627042.532253, 'auction_closing_time': 1770371100.0}
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118317404') HTTP/1.1" 204 0
2026-01-28 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119022584?view=catalogue)
2026-01-28 19:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190108f10>
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71ZSY%252F2026-01-28%252Fimage%252F8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c50b691c-fbdd-548b-9eab-16416036e648
2026-01-28 19:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c50b691c-fbdd-548b-9eab-16416036e648, skipping ID generation
2026-01-28 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50b691c-fbdd-548b-9eab-16416036e648 with scrape type 1
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c50b691c-fbdd-548b-9eab-16416036e648 from tracking dictionaries
2026-01-28 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c50b691c-fbdd-548b-9eab-16416036e648 sending to next pipeline
2026-01-28 19:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c50b691c-fbdd-548b-9eab-16416036e648, identifier: 118953753
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bf2d0>
2026-01-28 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252Fbaf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190494e90>
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319011b290>
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fbcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190496e90>
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML24FTU%252F2026-01-19%252Fimage%252F3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b206a489-0323-53f7-a3f0-1aa0ae9da13e
2026-01-28 19:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b206a489-0323-53f7-a3f0-1aa0ae9da13e, skipping ID generation
2026-01-28 19:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b206a489-0323-53f7-a3f0-1aa0ae9da13e with scrape type 1
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b206a489-0323-53f7-a3f0-1aa0ae9da13e from tracking dictionaries
2026-01-28 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b206a489-0323-53f7-a3f0-1aa0ae9da13e sending to next pipeline
2026-01-28 19:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b206a489-0323-53f7-a3f0-1aa0ae9da13e, identifier: 118735717
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190d2dbd0>
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837d9a90>
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fd45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904da490>
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2de57456-df30-40cf-b7a8-625f984a3064.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600 saved to cache
2026-01-28 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c50b691c-fbdd-548b-9eab-16416036e648 with identifier: 118953753
2026-01-28 19:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c50b691c-fbdd-548b-9eab-16416036e648 with identifier: 118953753
2026-01-28 19:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c50b691c-fbdd-548b-9eab-16416036e648 with identifier: 118953753 to the API
2026-01-28 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-05T10:00:00Z',
'fuel_type': 'Electric',
'id': 'c50b691c-fbdd-548b-9eab-16416036e648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LB71ZSY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118953753',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TESLA',
'model': 'MODEL 3 SALOON',
'odometer': 50711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26355,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/8413e468-4524-4e2e-9f72-862835972df9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25968,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/139ea9b8-5dac-4177-95b9-9f1a7e835c1a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27979,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/7d8c86c3-f43a-479a-acce-2117f3aa19f1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28313,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/49082c40-42a3-4918-aed7-246f66d6aa65_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32285,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/41a813bf-ff04-4bb1-a268-04a238de583d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39647,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/de39a7a0-0d03-4cb9-91de-fcfe47335f34_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40999,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/fec11a66-5be4-4f7b-968b-d6ff1f66a7a6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43306,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/a263b257-04b4-44f3-bcfb-72a5154b0cc0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50b691c-fbdd-548b-9eab-16416036e648/c50b691c-fbdd-548b-9eab-16416036e648_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37435,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB71ZSY/2026-01-28/image/1f19d1f0-8fef-4d9b-9a69-f34906e3c4fb_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seller_name': 'AAM Group',
'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 4dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953753%27 HTTP/1.1" 200 None
2026-01-28 19:04:05 [astonbarclay.gb] INFO: Saving data for 118953753: {'created_time': 1769627045.108154, 'last_price_update_time': 1769627045.108166, 'auction_closing_time': 1770285600.0}
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118953753') HTTP/1.1" 204 0
2026-01-28 19:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b206a489-0323-53f7-a3f0-1aa0ae9da13e with identifier: 118735717
2026-01-28 19:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b206a489-0323-53f7-a3f0-1aa0ae9da13e with identifier: 118735717
2026-01-28 19:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b206a489-0323-53f7-a3f0-1aa0ae9da13e with identifier: 118735717 to the API
2026-01-28 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Petrol',
'id': 'b206a489-0323-53f7-a3f0-1aa0ae9da13e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ML24FTU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118735717',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'RENAULT',
'model': 'CLIO HATCHBACK',
'odometer': 25959,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31181,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fe35996-72df-4258-b65e-2806a9bb31b1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31080,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/3a5a3f11-6503-43b2-a112-3e7ba3fadb40_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31951,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/baf645d8-b7a0-448a-a7dd-eff0886e45e0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30167,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3b94ec8-2a0d-4479-945f-8b16c29af439_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42522,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/39214f4e-dbe0-4427-9910-bb8dbe88c58e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59002,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/b3617715-8175-4627-8bc2-932847c92d67_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42850,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/33188ea6-9022-46d5-8f63-07e091adfa37_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43170,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/1fa59ac3-5cdd-4f8d-aae8-bd77dc703ac3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53638,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/de8f54dc-5ae2-4f92-acb4-748011becc96_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50418,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/a569ce65-ee79-43de-a824-7671c99d0d7d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b206a489-0323-53f7-a3f0-1aa0ae9da13e/b206a489-0323-53f7-a3f0-1aa0ae9da13e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46023,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/ML24FTU/2026-01-19/image/d6d54844-2f02-47da-b547-35f44e0e7164_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-09',
'seller_name': 'Kinto',
'title': 'RENAULT CLIO HATCHBACK 1.0 TCe 90 Evolution 5dr',
'transmission': 'manual',
'trim': '1.0 TCe 90 Evolution 5dr',
'vin': None,
'year': 2024}
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118735717%27 HTTP/1.1" 200 None
2026-01-28 19:04:06 [astonbarclay.gb] INFO: Saving data for 118735717: {'created_time': 1769627046.110452, 'last_price_update_time': 1769627046.110462, 'auction_closing_time': 1770371100.0}
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118735717') HTTP/1.1" 204 0
2026-01-28 19:04:06 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 28 pages/min), scraped 89 items (at 25 items/min)
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190088850>
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM72JGO%252F2026-01-19%252Fimage%252Fe79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9
2026-01-28 19:04:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9, skipping ID generation
2026-01-28 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with scrape type 1
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 from tracking dictionaries
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 sending to next pipeline
2026-01-28 19:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9, identifier: 118741136
2026-01-28 19:04:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118890106, 'registration': 'EN74MHK', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE ELECTRIC ESTATE', 'derivative': '100kW Ultimate XL 52kWh 5dr Auto', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc30b94a-4b57-4995-9974-eace1ce02072.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118890106, 'registration': 'EN74MHK', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE ELECTRIC ESTATE', 'derivative': '100kW Ultimate XL 52kWh 5dr Auto', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc30b94a-4b57-4995-9974-eace1ce02072.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cef97f1-f10f-5347-9d18-d70c45c94186 with identifier: 118890106
2026-01-28 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef97f1-f10f-5347-9d18-d70c45c94186 with scrape type 1
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190089e50>
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252F6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319011f610>
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN73TJU%252F2026-01-19%252Fimage%252F8415d725-faac-4564-912d-67b5563874cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8f360d8-6749-52f5-8cf7-847c84869f75
2026-01-28 19:04:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8f360d8-6749-52f5-8cf7-847c84869f75, skipping ID generation
2026-01-28 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f360d8-6749-52f5-8cf7-847c84869f75 with scrape type 1
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8f360d8-6749-52f5-8cf7-847c84869f75 from tracking dictionaries
2026-01-28 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8f360d8-6749-52f5-8cf7-847c84869f75 sending to next pipeline
2026-01-28 19:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8f360d8-6749-52f5-8cf7-847c84869f75, identifier: 118694625
2026-01-28 19:04:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118159423, 'registration': 'EN73VRC', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 10481, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-01-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN73VRC/2026-01-21/image/206430d0-53e5-47fd-8160-29232b80be5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/f4fbb31d-ab59-4a62-bc93-7a4dc78f5436_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/0f71236b-cf15-41ce-962a-4638e0a10053_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/815928b7-7370-49f3-a2f7-8dba29e81214_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/b9d320dd-dd29-4f53-a8de-2eb92475cb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/9363d85c-09f3-4c85-9d67-8f519b148f82_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/59733c1b-592e-4798-a70d-398d25c48130_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/5c4414e5-8421-4a21-abac-69f35eaf35b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/76b68476-68de-48a0-9806-c5a6a78dc65f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/9a12d919-4e09-46b5-bff4-219b9a89f2c5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40221c4c-90e7-4e53-b86a-7fb23013543d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118159423, 'registration': 'EN73VRC', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 10481, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-01-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN73VRC/2026-01-21/image/206430d0-53e5-47fd-8160-29232b80be5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/f4fbb31d-ab59-4a62-bc93-7a4dc78f5436_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/0f71236b-cf15-41ce-962a-4638e0a10053_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/815928b7-7370-49f3-a2f7-8dba29e81214_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/b9d320dd-dd29-4f53-a8de-2eb92475cb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/9363d85c-09f3-4c85-9d67-8f519b148f82_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/59733c1b-592e-4798-a70d-398d25c48130_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/5c4414e5-8421-4a21-abac-69f35eaf35b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/76b68476-68de-48a0-9806-c5a6a78dc65f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN73VRC/2026-01-21/image/9a12d919-4e09-46b5-bff4-219b9a89f2c5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40221c4c-90e7-4e53-b86a-7fb23013543d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d48316bb-e410-560a-b080-c9b3f075ef4a with identifier: 118159423
2026-01-28 19:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d48316bb-e410-560a-b080-c9b3f075ef4a with scrape type 2
2026-01-28 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d48316bb-e410-560a-b080-c9b3f075ef4a with scrape type 2
2026-01-28 19:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d48316bb-e410-560a-b080-c9b3f075ef4a, identifier: 118159423
2026-01-28 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119036866?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118715535?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with identifier: 118741136
2026-01-28 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with identifier: 118741136
2026-01-28 19:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aacb4423-1bee-5402-9e5d-84ec2a7dc7c9 with identifier: 118741136 to the API
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Petrol',
'id': 'aacb4423-1bee-5402-9e5d-84ec2a7dc7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YM72JGO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118741136',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'ECOSPORT HATCHBACK',
'odometer': 25954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24665,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/ef697519-8875-47f2-86ba-520b5d5ddb7b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25259,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/e79a784d-5a4a-4350-a4ac-72b2ed264441_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21752,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/d45d3f19-2a1b-4c79-a306-45cc4aad5813_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20683,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/bcdffb64-f796-456f-917c-7fe9d20cb552_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36072,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/9355b34b-f567-4c6d-9b5f-220c4b471cba_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44506,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/8fd31cc6-da7a-419f-9864-ae9fa867ade0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34970,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/459296b3-d2fc-49d0-abdb-ca1a6403fb55_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35464,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/2a8de6af-1114-4655-a1ce-1fc213780295_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aacb4423-1bee-5402-9e5d-84ec2a7dc7c9/aacb4423-1bee-5402-9e5d-84ec2a7dc7c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43293,
'Height': 338,
'OriginUrl': 'https://abimg003.imgix.net/YM72JGO/2026-01-19/image/02f2c698-add8-423d-b384-813724e00696_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seller_name': 'Kinto',
'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 ST-Line [X Pack] 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 125 ST-Line [X Pack] 5dr',
'vin': None,
'year': 2023}
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118741136%27 HTTP/1.1" 200 None
2026-01-28 19:04:07 [astonbarclay.gb] INFO: Saving data for 118741136: {'created_time': 1769627047.518882, 'last_price_update_time': 1769627047.518892, 'auction_closing_time': 1770371100.0}
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118741136') HTTP/1.1" 204 0
2026-01-28 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8f360d8-6749-52f5-8cf7-847c84869f75 with identifier: 118694625
2026-01-28 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8f360d8-6749-52f5-8cf7-847c84869f75 with identifier: 118694625
2026-01-28 19:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8f360d8-6749-52f5-8cf7-847c84869f75 with identifier: 118694625 to the API
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 28,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-06T09:45:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': 'f8f360d8-6749-52f5-8cf7-847c84869f75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DN73TJU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118694625',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VAUXHALL',
'model': 'GRANDLAND HATCHBACK',
'odometer': 35655,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38374,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b030b410-77ae-4b26-ade5-0e0c3174efd4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35966,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/8415d725-faac-4564-912d-67b5563874cc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36954,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/9ab9673d-dccc-48e1-95f6-976c3cb8cb0e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36148,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/836cdaa6-72f1-454c-a31a-e1a59ddd23bd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41802,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/900f9eb5-9d17-4fc3-8921-393d4ea8721c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55353,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/7f9207b8-de8d-4556-b698-d541023dee1f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52392,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/b6838324-89fb-4225-9a54-235d785db5cd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56221,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/995fe25e-72bc-49d3-b313-a74e464d2bd8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8f360d8-6749-52f5-8cf7-847c84869f75/f8f360d8-6749-52f5-8cf7-847c84869f75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51983,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN73TJU/2026-01-19/image/c2fb5881-3277-4aed-ad63-556b4f0bf4de_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-06',
'seller_name': 'Kinto',
'title': 'VAUXHALL GRANDLAND HATCHBACK 1.6 Plug-in Hybrid GS 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 Plug-in Hybrid GS 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118694625%27 HTTP/1.1" 200 None
2026-01-28 19:04:07 [astonbarclay.gb] INFO: Saving data for 118694625: {'created_time': 1769627047.870648, 'last_price_update_time': 1769627047.870659, 'auction_closing_time': 1770371100.0}
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118694625') HTTP/1.1" 204 0
2026-01-28 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d48316bb-e410-560a-b080-c9b3f075ef4a with identifier: 118159423
2026-01-28 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d48316bb-e410-560a-b080-c9b3f075ef4a with identifier: 118159423
2026-01-28 19:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d48316bb-e410-560a-b080-c9b3f075ef4a with identifier: 118159423 to the API
2026-01-28 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118159423?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd48316bb-e410-560a-b080-c9b3f075ef4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EN73VRC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118159423',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'JEEP',
'model': 'AVENGER HATCHBACK',
'odometer': 10481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-18',
'seller_name': 'Motability Operations',
'title': 'JEEP AVENGER HATCHBACK 1.2 Altitude+ 5dr',
'transmission': 'manual',
'trim': '1.2 Altitude+ 5dr',
'vin': None,
'year': 2024}
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118159423%27 HTTP/1.1" 200 None
2026-01-28 19:04:08 [astonbarclay.gb] INFO: Saving data for 118159423: {'auction_closing_time': 1770631200.0, 'created_time': 1768331742.149746, 'last_price_update_time': 1769627048.176139}
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118159423') HTTP/1.1" 204 0
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183720090>
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fe6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009e4d0>
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM20ZBD%252F2026-01-28%252Fimage%252Fd879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 987fa600-e67f-5345-83e8-a3729bb54e8e
2026-01-28 19:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 987fa600-e67f-5345-83e8-a3729bb54e8e, skipping ID generation
2026-01-28 19:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 987fa600-e67f-5345-83e8-a3729bb54e8e with scrape type 1
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 987fa600-e67f-5345-83e8-a3729bb54e8e from tracking dictionaries
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 987fa600-e67f-5345-83e8-a3729bb54e8e sending to next pipeline
2026-01-28 19:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 987fa600-e67f-5345-83e8-a3729bb54e8e, identifier: 119022584
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994826?view=catalogue)
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119088693?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119030718?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 987fa600-e67f-5345-83e8-a3729bb54e8e with identifier: 119022584
2026-01-28 19:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 987fa600-e67f-5345-83e8-a3729bb54e8e with identifier: 119022584
2026-01-28 19:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 987fa600-e67f-5345-83e8-a3729bb54e8e with identifier: 119022584 to the API
2026-01-28 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': '987fa600-e67f-5345-83e8-a3729bb54e8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KM20ZBD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119022584',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'GLC DIESEL ESTATE',
'odometer': 63602,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36567,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/144beca1-d9ad-48c3-9020-835b21d2819e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45833,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/084df238-adf2-41a3-aae6-b873e4215e5e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39848,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/542d4352-9e7e-46c6-9484-1cf83ee940e1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40595,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e6be933c-2c46-4e58-822a-ad6f0aa37364_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46719,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/edf19d60-90f9-4042-9f35-4944f13560cf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55582,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/25272f47-8d24-437b-abf1-32dc2ddacda0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/6f825f3f-ed6d-43aa-974b-5896998ad308_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65069,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/d879ebc5-bf6b-446c-b69a-b03dd67c3e10_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52993,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/b8b822c4-889f-4b7e-8eff-396c099b6274_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987fa600-e67f-5345-83e8-a3729bb54e8e/987fa600-e67f-5345-83e8-a3729bb54e8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59236,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KM20ZBD/2026-01-28/image/e758660e-96ec-4245-aee1-42d9c0f252d4_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-18',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 220d 4Matic AMG Line Premium '
'5dr 9G-Tronic',
'transmission': 'automatic',
'trim': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic',
'vin': None,
'year': 2020}
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022584%27 HTTP/1.1" 200 None
2026-01-28 19:04:09 [astonbarclay.gb] INFO: Saving data for 119022584: {'created_time': 1769627049.229585, 'last_price_update_time': 1769627049.229595, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119022584') HTTP/1.1" 204 0
2026-01-28 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119054522?view=catalogue)
2026-01-28 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190296510>
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252Fdc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119036866, 'registration': 'KW70KKR', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS ESTATE', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr', 'mileage': 36619, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-12-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d6f657e4-c1a6-4388-8351-173420d2e32c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119036866, 'registration': 'KW70KKR', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS ESTATE', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr', 'mileage': 36619, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-12-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d6f657e4-c1a6-4388-8351-173420d2e32c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb7badc-35b4-5e4b-b093-715e3954d302 with identifier: 119036866
2026-01-28 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb7badc-35b4-5e4b-b093-715e3954d302 with scrape type 1
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item dbb7badc-35b4-5e4b-b093-715e3954d302
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item dbb7badc-35b4-5e4b-b093-715e3954d302
2026-01-28 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dbb7badc-35b4-5e4b-b093-715e3954d302, identifier: 119036866
2026-01-28 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118715535, 'registration': 'EX73FEG', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 1089, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118715535, 'registration': 'EX73FEG', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 1089, 'mileageWarranty': True, 'type': 'car', 'saleId': 18384, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ca206e-db1b-58a6-9c9f-2af47128980e with identifier: 118715535
2026-01-28 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ca206e-db1b-58a6-9c9f-2af47128980e with scrape type 1
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 70ca206e-db1b-58a6-9c9f-2af47128980e
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252Fe46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904d50d0>
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191671e90>
2026-01-28 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV69HCD%252F2026-01-28%252Fimage%252F0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0
2026-01-28 19:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0, skipping ID generation
2026-01-28 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with scrape type 1
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 from tracking dictionaries
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 sending to next pipeline
2026-01-28 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0, identifier: 118994826
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904d5210>
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190327d50>
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119017250, 'registration': 'AD19FOC', 'account': 'WBA002', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '530d M Sport 4dr Auto', 'mileage': 47370, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-04-08', 'doors': 4, 'engineSize': 2993, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2fefc4a-6d38-40a3-a16b-7821dfd03c22.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119017250, 'registration': 'AD19FOC', 'account': 'WBA002', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '530d M Sport 4dr Auto', 'mileage': 47370, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-04-08', 'doors': 4, 'engineSize': 2993, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600', 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2fefc4a-6d38-40a3-a16b-7821dfd03c22.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d714e0a6-fcee-5aec-8e4e-19352c6f2883 with identifier: 119017250
2026-01-28 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d714e0a6-fcee-5aec-8e4e-19352c6f2883 with scrape type 1
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118996198, 'registration': 'FM69ZYG', 'account': 'MER176', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 AMG Line 5dr', 'mileage': 43281, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600', 'https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600', 'https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600', 'https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600', 'https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600', 'https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600', 'https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600', 'https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Hugo- missed one service.', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/381badd0-fe7b-436e-97ec-168bc9d22ec3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118996198, 'registration': 'FM69ZYG', 'account': 'MER176', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 AMG Line 5dr', 'mileage': 43281, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600', 'https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600', 'https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600', 'https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600', 'https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600', 'https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600', 'https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600', 'https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Hugo- missed one service.', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/381badd0-fe7b-436e-97ec-168bc9d22ec3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with identifier: 118996198
2026-01-28 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with scrape type 1
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1f687487-4ca1-411a-a90c-bd381aabe807.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600 not downloaded yet
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119088693, 'registration': 'RA71BRF', 'account': 'MER176', 'make': 'JAGUAR', 'model': 'XE SALOON', 'derivative': '2.0 P300 R-Dynamic HSE 4dr Auto AWD', 'mileage': 19894, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-25', 'fuel': 'Petrol', 'motExpiry': '2027-01-15', 'doors': 4, 'engineSize': 1997, 'bodyType': 'Saloon', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 206, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119088693, 'registration': 'RA71BRF', 'account': 'MER176', 'make': 'JAGUAR', 'model': 'XE SALOON', 'derivative': '2.0 P300 R-Dynamic HSE 4dr Auto AWD', 'mileage': 19894, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-25', 'fuel': 'Petrol', 'motExpiry': '2027-01-15', 'doors': 4, 'engineSize': 1997, 'bodyType': 'Saloon', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 206, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9508b5ee-8a70-5185-8eed-8867b6799106 with identifier: 119088693
2026-01-28 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9508b5ee-8a70-5185-8eed-8867b6799106 with scrape type 1
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9508b5ee-8a70-5185-8eed-8867b6799106
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9508b5ee-8a70-5185-8eed-8867b6799106
2026-01-28 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9508b5ee-8a70-5185-8eed-8867b6799106, identifier: 119088693
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119030718, 'registration': 'DA18JKU', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK SPECIAL EDITIONS', 'derivative': '1.2 Collezione 3dr', 'mileage': 62319, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-23', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/118ff044-d5b1-4f91-b14f-3ddb23bd1301.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119030718, 'registration': 'DA18JKU', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK SPECIAL EDITIONS', 'derivative': '1.2 Collezione 3dr', 'mileage': 62319, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-23', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/118ff044-d5b1-4f91-b14f-3ddb23bd1301.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0340d4a2-babc-51ff-92ec-201e256b7c94 with identifier: 119030718
2026-01-28 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0340d4a2-babc-51ff-92ec-201e256b7c94 with scrape type 1
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0340d4a2-babc-51ff-92ec-201e256b7c94
2026-01-28 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0340d4a2-babc-51ff-92ec-201e256b7c94
2026-01-28 19:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0340d4a2-babc-51ff-92ec-201e256b7c94, identifier: 119030718
2026-01-28 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dbb7badc-35b4-5e4b-b093-715e3954d302 with identifier: 119036866
2026-01-28 19:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dbb7badc-35b4-5e4b-b093-715e3954d302 with identifier: 119036866
2026-01-28 19:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dbb7badc-35b4-5e4b-b093-715e3954d302 with identifier: 119036866 to the API
2026-01-28 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27dbb7badc-35b4-5e4b-b093-715e3954d302%27 HTTP/1.1" 200 None
2026-01-28 19:04:12 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id dbb7badc-35b4-5e4b-b093-715e3954d302: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119036866?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dbb7badc-35b4-5e4b-b093-715e3954d302',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KW70KKR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119036866',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FOCUS ESTATE',
'odometer': 36619,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-19',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FOCUS ESTATE 1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036866%27 HTTP/1.1" 200 None
2026-01-28 19:04:12 [astonbarclay.gb] INFO: Saving data for 119036866: {'created_time': 1769627052.177753, 'last_price_update_time': 1769627052.177764, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119036866') HTTP/1.1" 204 0
2026-01-28 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with identifier: 118994826
2026-01-28 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with identifier: 118994826
2026-01-28 19:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 27be4957-b5c0-5d38-816d-a4d2ec1a16b0 with identifier: 118994826 to the API
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '27be4957-b5c0-5d38-816d-a4d2ec1a16b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'HV69HCD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118994826',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'SEAT',
'model': 'TARRACO ESTATE',
'odometer': 85593,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31593,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/6a1a30ac-7cc2-4a6f-89ff-e454c8b00087_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33472,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ddeb84b3-d74c-4cb8-a7e0-24f88af3bf21_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34194,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/0be40360-381b-459f-9d3d-1d9f86fab888_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32161,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/ce9f3c6b-3a9a-47de-96c9-1242570cb57f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79000,
'Height': 800,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/b7197d17-e3da-4465-ba94-da8f6429e72c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74090,
'Height': 800,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/3f7aa62f-0ed1-4883-941f-465385ece06b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52987,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/53b940cc-f224-4e3d-8cff-72689ed7b245_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58794,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/552e103d-0d47-413c-8329-8085f85d317b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27be4957-b5c0-5d38-816d-a4d2ec1a16b0/27be4957-b5c0-5d38-816d-a4d2ec1a16b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43334,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/HV69HCD/2026-01-28/image/a26c690a-b71a-4506-be73-80327b095a75_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seller_name': 'Mercedes-Benz South West',
'title': 'SEAT TARRACO ESTATE 1.5 EcoTSI SE Technology 5dr',
'transmission': 'manual',
'trim': '1.5 EcoTSI SE Technology 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994826%27 HTTP/1.1" 200 None
2026-01-28 19:04:12 [astonbarclay.gb] INFO: Saving data for 118994826: {'created_time': 1769627052.565862, 'last_price_update_time': 1769627052.565874, 'auction_closing_time': 1770198300.0}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118994826') HTTP/1.1" 204 0
2026-01-28 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9508b5ee-8a70-5185-8eed-8867b6799106 with identifier: 119088693
2026-01-28 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9508b5ee-8a70-5185-8eed-8867b6799106 with identifier: 119088693
2026-01-28 19:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9508b5ee-8a70-5185-8eed-8867b6799106 with identifier: 119088693 to the API
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279508b5ee-8a70-5185-8eed-8867b6799106%27 HTTP/1.1" 200 None
2026-01-28 19:04:12 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9508b5ee-8a70-5185-8eed-8867b6799106: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119088693?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 206,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9508b5ee-8a70-5185-8eed-8867b6799106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'RA71BRF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119088693',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'JAGUAR',
'model': 'XE SALOON',
'odometer': 19894,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'seller_name': 'Hedin Automotive',
'title': 'JAGUAR XE SALOON 2.0 P300 R-Dynamic HSE 4dr Auto AWD',
'transmission': 'automatic',
'trim': '2.0 P300 R-Dynamic HSE 4dr Auto AWD',
'vin': None,
'year': 2022}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119088693%27 HTTP/1.1" 200 None
2026-01-28 19:04:12 [astonbarclay.gb] INFO: Saving data for 119088693: {'created_time': 1769627052.844195, 'last_price_update_time': 1769627052.844207, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119088693') HTTP/1.1" 204 0
2026-01-28 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0340d4a2-babc-51ff-92ec-201e256b7c94 with identifier: 119030718
2026-01-28 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0340d4a2-babc-51ff-92ec-201e256b7c94 with identifier: 119030718
2026-01-28 19:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0340d4a2-babc-51ff-92ec-201e256b7c94 with identifier: 119030718 to the API
2026-01-28 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270340d4a2-babc-51ff-92ec-201e256b7c94%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0340d4a2-babc-51ff-92ec-201e256b7c94: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119030718?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0340d4a2-babc-51ff-92ec-201e256b7c94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DA18JKU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119030718',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FIAT',
'model': '500 HATCHBACK SPECIAL EDITIONS',
'odometer': 62319,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': 'UKCGR - Premium',
'title': 'FIAT 500 HATCHBACK SPECIAL EDITIONS 1.2 Collezione 3dr',
'transmission': 'manual',
'trim': '1.2 Collezione 3dr',
'vin': None,
'year': 2018}
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119030718%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [astonbarclay.gb] INFO: Saving data for 119030718: {'created_time': 1769627053.133079, 'last_price_update_time': 1769627053.13309, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119030718') HTTP/1.1" 204 0
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905266d0>
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66AWW%252F2026-01-28%252Fimage%252F0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958
2026-01-28 19:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958, skipping ID generation
2026-01-28 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 with scrape type 1
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 from tracking dictionaries
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 sending to next pipeline
2026-01-28 19:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958, identifier: 119054522
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118994797?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fbd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 with identifier: 119054522
2026-01-28 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 with identifier: 119054522
2026-01-28 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 spider: astonbarclay.gb
2026-01-28 19:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Diesel',
'id': 'a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'HV66AWW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119054522',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'BMW',
'model': 'X3 DIESEL ESTATE',
'odometer': 82491,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31306,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/d60de1c5-d3f2-464d-9c49-ac892c291457_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28316,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/0961a189-b2d4-4b69-86fc-00404e798d72_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30407,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/9a1adba9-a501-49d4-ae4c-78c1a4089a71_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31954,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/60bbf2b3-926d-4f8f-bec1-ca28880c6b1f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49406,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/cb84f63d-b796-483f-a9f5-433d10c6b90a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41422,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/ad3d2061-f72d-46cb-b82d-12830e533ea6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88686,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b875d0c0-dc0c-4a50-908e-d251fd480e47_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91327,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/e67a6e48-f33b-4979-983a-b7cb0c46f8e6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46260,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/dc1691a6-a23d-4f30-b586-7b54035bfd51_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55618,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/df4ebc2e-b6ec-4d00-b8cf-0e447f16f925_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43623,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/56335fe7-62d0-4976-b1d4-1e558fb258d8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43615,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/06052304-609f-4f1b-a7a6-e17ae219f6c7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958/a76c4ffb-2b51-5ee4-beaa-0b4ee8f65958_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55341,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/HV66AWW/2026-01-28/image/b8d56bb5-044a-4e74-b98f-3f74196312d7_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seller_name': 'Mercedes-Benz South West',
'title': 'BMW X3 DIESEL ESTATE xDrive20d xLine 5dr Step Auto',
'transmission': 'automatic',
'trim': 'xDrive20d xLine 5dr Step Auto',
'vin': None,
'year': 2016}
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119054522%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [astonbarclay.gb] INFO: Saving data for 119054522: {'created_time': 1769627053.726193, 'last_price_update_time': 1769627053.726204, 'auction_closing_time': 1770198300.0}
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119054522') HTTP/1.1" 204 0
2026-01-28 19:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118918193?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118724798?view=catalogue)
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118940557?view=catalogue)
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119022350?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fa0104046-b753-4adc-931b-fd70f4138501_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190473090>
2026-01-28 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBC68XXJ%252F2026-01-28%252Fimage%252F123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 520b2600-3466-5305-b319-5530aab7b91b
2026-01-28 19:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 520b2600-3466-5305-b319-5530aab7b91b, skipping ID generation
2026-01-28 19:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520b2600-3466-5305-b319-5530aab7b91b with scrape type 1
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 520b2600-3466-5305-b319-5530aab7b91b from tracking dictionaries
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 520b2600-3466-5305-b319-5530aab7b91b sending to next pipeline
2026-01-28 19:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 520b2600-3466-5305-b319-5530aab7b91b, identifier: 118994797
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837c74d0>
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191673a10>
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252Fc6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190377a10>
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904cff90>
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190318390>
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118715535?view=catalogue)
2026-01-28 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Fd02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F54c95cee-fd42-4597-a149-9da0c2a89efd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600 not downloaded yet
2026-01-28 19:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 520b2600-3466-5305-b319-5530aab7b91b with identifier: 118994797
2026-01-28 19:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 520b2600-3466-5305-b319-5530aab7b91b with identifier: 118994797
2026-01-28 19:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 520b2600-3466-5305-b319-5530aab7b91b with identifier: 118994797 to the API
2026-01-28 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 164,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Petrol',
'id': '520b2600-3466-5305-b319-5530aab7b91b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BC68XXJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118994797',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'FORD',
'model': 'KUGA ESTATE',
'odometer': 63150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29714,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7ee23932-4609-4ca1-a5a2-a60bebb7ec5f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27994,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/123a6242-8a99-4033-8253-14fc71c27f4c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30767,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2bab9f25-f6ff-4b92-836c-ce52836e1dac_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30182,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a559f85-25d8-406b-bc34-9201db0af6f0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45325,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7f5052c7-7f40-4f7b-b179-6ef9b1ff834d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93123,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/75e517d1-7326-4f59-9186-f9592f6e556f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91005,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/2da16630-383b-42d5-85dd-1991ecece814_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45605,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/8a900a72-f767-49f5-a1a9-8e94fb287630_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520b2600-3466-5305-b319-5530aab7b91b/520b2600-3466-5305-b319-5530aab7b91b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42187,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BC68XXJ/2026-01-28/image/7a6e9e31-8188-4482-a329-2427dffb4f85_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-31',
'seller_name': 'Mercedes-Benz South West',
'title': 'FORD KUGA ESTATE 1.5 EcoBoost ST-Line 5dr 2WD',
'transmission': 'manual',
'trim': '1.5 EcoBoost ST-Line 5dr 2WD',
'vin': None,
'year': 2019}
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118994797%27 HTTP/1.1" 200 None
2026-01-28 19:04:16 [astonbarclay.gb] INFO: Saving data for 118994797: {'created_time': 1769627056.888703, 'last_price_update_time': 1769627056.888715, 'auction_closing_time': 1770198300.0}
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118994797') HTTP/1.1" 204 0
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fd3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Fe4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600 not downloaded yet
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190162810>
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600 saved to cache
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff
2026-01-28 19:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff, skipping ID generation
2026-01-28 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with scrape type 1
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff from tracking dictionaries
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03391e64-6f8b-5c3b-8bd3-4bff95c37aff sending to next pipeline
2026-01-28 19:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff, identifier: 118918193
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904d4d90>
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX72POV%252F2026-01-19%252Fimage%252F429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09433e2c-d8d3-5982-b321-83c1f25746ff
2026-01-28 19:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09433e2c-d8d3-5982-b321-83c1f25746ff, skipping ID generation
2026-01-28 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09433e2c-d8d3-5982-b321-83c1f25746ff with scrape type 1
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 09433e2c-d8d3-5982-b321-83c1f25746ff from tracking dictionaries
2026-01-28 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09433e2c-d8d3-5982-b321-83c1f25746ff sending to next pipeline
2026-01-28 19:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 09433e2c-d8d3-5982-b321-83c1f25746ff, identifier: 118724798
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904afb90>
2026-01-28 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV21FTE%252F2026-01-23%252Fimage%252F0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f
2026-01-28 19:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f, skipping ID generation
2026-01-28 19:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f with scrape type 1
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f from tracking dictionaries
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f sending to next pipeline
2026-01-28 19:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f, identifier: 118940557
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119022350, 'registration': 'YN19BSB', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line X 5dr', 'mileage': 60890, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-01', 'fuel': 'Petrol', 'motExpiry': '2026-10-17', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16846527-5a10-4d73-b556-df301ca93365.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119022350, 'registration': 'YN19BSB', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line X 5dr', 'mileage': 60890, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-01', 'fuel': 'Petrol', 'motExpiry': '2026-10-17', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16846527-5a10-4d73-b556-df301ca93365.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 619118cd-53c5-5edc-9318-850b88aed9fa with identifier: 119022350
2026-01-28 19:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 619118cd-53c5-5edc-9318-850b88aed9fa with scrape type 1
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 619118cd-53c5-5edc-9318-850b88aed9fa
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 619118cd-53c5-5edc-9318-850b88aed9fa
2026-01-28 19:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 619118cd-53c5-5edc-9318-850b88aed9fa, identifier: 119022350
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119034549, 'registration': 'SA22MHE', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'B200 AMG Line Premium Edition 5dr Auto', 'mileage': 64635, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf5616a6-5bec-43a4-9aca-f1ee5e7d1fe0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119034549, 'registration': 'SA22MHE', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'B200 AMG Line Premium Edition 5dr Auto', 'mileage': 64635, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf5616a6-5bec-43a4-9aca-f1ee5e7d1fe0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7371390-31d0-5f87-b367-1d6dc5ff4bfc with identifier: 119034549
2026-01-28 19:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc with scrape type 1
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fe28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with identifier: 118918193
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with identifier: 118918193
2026-01-28 19:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 03391e64-6f8b-5c3b-8bd3-4bff95c37aff with identifier: 118918193 to the API
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '03391e64-6f8b-5c3b-8bd3-4bff95c37aff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LO69VJJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118918193',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'C CLASS SALOON',
'odometer': 22645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86372,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/694aedf1-cc15-4f0a-b816-f99f89a64e2b.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80250,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/641a05f9-8064-4c59-83ab-43c88101ce91.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66451,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/7f900e37-7e3c-4b9c-8531-bf7b84840182.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77811,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/3eefaa59-74b8-4888-b85a-4aaea73da5fb.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88055,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/29d75b1e-7ca5-4e3e-9382-025149ca79ed.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87562,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/3871e9f1-ba25-4e6e-bd58-9669910d6092.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77588,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/b7f830d8-9de1-413c-8278-7d6fcffb331d.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03391e64-6f8b-5c3b-8bd3-4bff95c37aff/03391e64-6f8b-5c3b-8bd3-4bff95c37aff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42020,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/2de57456-df30-40cf-b7a8-625f984a3064.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-31',
'seller_name': 'Hedin Automotive',
'title': 'MERCEDES-BENZ C CLASS SALOON C300 Sport 4dr 9G-Tronic',
'transmission': 'automatic',
'trim': 'C300 Sport 4dr 9G-Tronic',
'vin': None,
'year': 2019}
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118918193%27 HTTP/1.1" 200 None
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Saving data for 118918193: {'created_time': 1769627058.623197, 'last_price_update_time': 1769627058.623207, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118918193') HTTP/1.1" 204 0
2026-01-28 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 09433e2c-d8d3-5982-b321-83c1f25746ff with identifier: 118724798
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 09433e2c-d8d3-5982-b321-83c1f25746ff with identifier: 118724798
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'interbay asset finance', 'price_includes_vat': False, 'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqb estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51695, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724798', 'expiration_date': '2026-02-04t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': 'eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'license_plate': 'gx72pov', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '09433e2c-d8d3-5982-b321-83c1f25746ff', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30675}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 104494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 92504}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39559}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 51482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 47795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48299}], 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mercedes-benz eqb estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 83194} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-04t09:45:00z',
'fuel_type': 'electric',
'id': '09433e2c-d8d3-5982-b321-83c1f25746ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'gx72pov',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724798',
'listing': 'auction',
'location': 'aston barclay westbury',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqb estate',
'model': 'eqb estate',
'odometer': 51695,
'odometer_in_km': 83194,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30675,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28399,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30515,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30331,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104494,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92504,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39559,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51482,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47795,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48299,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'sanitized_make': 'mercedesbenz',
'seller_name': 'interbay asset finance',
'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line premium '
'66.5kwh 5dr auto',
'transmission': 'automatic',
'trim': 'eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 09433e2c-d8d3-5982-b321-83c1f25746ff spider: astonbarclay.gb
2026-01-28 19:04:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 09433e2c-d8d3-5982-b321-83c1f25746ff due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'interbay asset finance', 'price_includes_vat': False, 'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqb estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51695, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724798', 'expiration_date': '2026-02-04t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': 'eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'license_plate': 'gx72pov', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '09433e2c-d8d3-5982-b321-83c1f25746ff', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30675}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 104494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 92504}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39559}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 51482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 47795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48299}], 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'mercedes-benz eqb estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 83194} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-04t09:45:00z',
'fuel_type': 'electric',
'id': '09433e2c-d8d3-5982-b321-83c1f25746ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'gx72pov',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724798',
'listing': 'auction',
'location': 'aston barclay westbury',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz eqb estate',
'model': 'eqb estate',
'odometer': 51695,
'odometer_in_km': 83194,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30675,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28399,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30515,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30331,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104494,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92504,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39559,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51482,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47795,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48299,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'sanitized_make': 'mercedesbenz',
'seller_name': 'interbay asset finance',
'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line premium '
'66.5kwh 5dr auto',
'transmission': 'automatic',
'trim': 'eqb 350 4m 215kw amg line premium 66.5kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Electric',
'id': '09433e2c-d8d3-5982-b321-83c1f25746ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GX72POV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724798',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'MERCEDES-BENZ',
'model': 'EQB ESTATE',
'odometer': 51695,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30675,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d0184093-b20c-4c0d-8421-661193668dd9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28399,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/82d1cf7b-7218-4375-81ad-9e5bed73670b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30515,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/6a340e37-ae27-4cd8-8284-df4fffd1ca0a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30331,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/fe4bc624-ed00-4032-9ab6-5d89f10b53e1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104494,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/9426510b-2c3c-4213-b6fd-9e3cca96a1d0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92504,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/429c111e-0cbd-472a-b472-2ad4637b1202_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39559,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/d1552a85-af66-4993-99ff-1da37b943b0c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51482,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/8c8306bb-2cdc-4d9d-be9c-f9e0762e9eb3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47795,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/f96f1922-b00b-4cc6-8e9b-5bc79e137d97_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09433e2c-d8d3-5982-b321-83c1f25746ff/09433e2c-d8d3-5982-b321-83c1f25746ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48299,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GX72POV/2026-01-19/image/670e67c5-1973-486d-9890-3fad34fdfabe_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seller_name': 'Interbay Asset Finance',
'title': 'MERCEDES-BENZ EQB ESTATE EQB 350 4M 215kW AMG Line Premium 66.5kWh '
'5dr Auto',
'transmission': 'automatic',
'trim': 'EQB 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724798%27 HTTP/1.1" 200 None
2026-01-28 19:04:18 [astonbarclay.gb] INFO: Saving data for 118724798: {'created_time': 1769627058.837961, 'last_price_update_time': 1769627058.837972, 'auction_closing_time': 1770198300.0}
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118724798') HTTP/1.1" 204 0
2026-01-28 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f with identifier: 118940557
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f with identifier: 118940557
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149271 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
149271
2026-01-28 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f spider: astonbarclay.gb
2026-01-28 19:04:19 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 46aa4c90-1ccb-5e3d-86cb-c30d9bec037f due to rule: high_mileage_for_make.json, error: 149271 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
149271
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-04T09:45:00Z',
'fuel_type': 'Electric',
'id': '46aa4c90-1ccb-5e3d-86cb-c30d9bec037f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BV21FTE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118940557',
'listing': 'auction',
'location': 'Aston Barclay Westbury',
'make': 'TESLA',
'model': 'MODEL 3 SALOON',
'odometer': 92753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23370,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/8f33a71a-40b4-4929-93db-9f4b02a4e8b5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22794,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/081dd9b0-6d7f-4066-a25a-a47821816db8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25338,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/2a474b09-dc10-4716-8642-fc9c35c8ed1f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24847,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/42d1f8c2-4e11-45d1-8ef1-5a48d0f3f47e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30396,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/40f8afe9-6d56-422e-8a12-918ba55a6474_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79494,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/0058970d-9345-4953-9ae0-5052d5453f0d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66804,
'Height': 960,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/b939f3a8-245c-486d-b651-36223c8ddbca_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27888,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/c6b867ba-bec3-479d-853b-bc8c7988f3ae_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46aa4c90-1ccb-5e3d-86cb-c30d9bec037f/46aa4c90-1ccb-5e3d-86cb-c30d9bec037f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41291,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/BV21FTE/2026-01-23/image/69a31a71-9e6e-4b38-99dd-fade7f6611a5_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seller_name': 'Interbay Asset Finance',
'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 4dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118940557%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [astonbarclay.gb] INFO: Saving data for 118940557: {'created_time': 1769627059.061364, 'last_price_update_time': 1769627059.061374, 'auction_closing_time': 1770198300.0}
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118940557') HTTP/1.1" 204 0
2026-01-28 19:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 619118cd-53c5-5edc-9318-850b88aed9fa with identifier: 119022350
2026-01-28 19:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 619118cd-53c5-5edc-9318-850b88aed9fa with identifier: 119022350
2026-01-28 19:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 619118cd-53c5-5edc-9318-850b88aed9fa with identifier: 119022350 to the API
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27619118cd-53c5-5edc-9318-850b88aed9fa%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 619118cd-53c5-5edc-9318-850b88aed9fa: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119022350?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '619118cd-53c5-5edc-9318-850b88aed9fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YN19BSB',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119022350',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 60890,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-01',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 140 ST-Line X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 140 ST-Line X 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119022350%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [astonbarclay.gb] INFO: Saving data for 119022350: {'created_time': 1769627059.342626, 'last_price_update_time': 1769627059.342637, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119022350') HTTP/1.1" 204 0
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190339810>
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252Fe46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70ca206e-db1b-58a6-9c9f-2af47128980e
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183784450>
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Faddef70f-893c-4b50-9e88-d4456293b468.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600 not downloaded yet
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fa1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118715535?view=catalogue)
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118715535?view=catalogue)
2026-01-28 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119053970?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837009d0>
2026-01-28 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183725890>
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904ae990>
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318362e9d0>
2026-01-28 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252Fd6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183748050>
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1f687487-4ca1-411a-a90c-bd381aabe807.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600 saved to cache
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190294650>
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319035e590>
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fbd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600 saved to cache
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600 not downloaded yet
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fb0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Febf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fdcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600 not downloaded yet
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119027974?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118649320?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118827410?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190263bd0>
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319164dfd0>
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fa0104046-b753-4adc-931b-fd70f4138501_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183671790>
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252F406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190105c50>
2026-01-28 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190104f50>
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70ca206e-db1b-58a6-9c9f-2af47128980e
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a6a350>
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70ca206e-db1b-58a6-9c9f-2af47128980e
2026-01-28 19:04:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119053970, 'registration': 'LO69DFK', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Edition Plus 5dr Auto', 'mileage': 35652, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-12-10', 'fuel': 'Petrol', 'motExpiry': '2027-01-12', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a545a7e-f93c-4d00-9c6d-91333d88cac9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119053970, 'registration': 'LO69DFK', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Edition Plus 5dr Auto', 'mileage': 35652, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-12-10', 'fuel': 'Petrol', 'motExpiry': '2027-01-12', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a545a7e-f93c-4d00-9c6d-91333d88cac9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f388ad-4892-5338-8f1f-2959999e1e30 with identifier: 119053970
2026-01-28 19:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f388ad-4892-5338-8f1f-2959999e1e30 with scrape type 1
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e6f388ad-4892-5338-8f1f-2959999e1e30
2026-01-28 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e6f388ad-4892-5338-8f1f-2959999e1e30
2026-01-28 19:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e6f388ad-4892-5338-8f1f-2959999e1e30, identifier: 119053970
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e6f388ad-4892-5338-8f1f-2959999e1e30 with identifier: 119053970
2026-01-28 19:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e6f388ad-4892-5338-8f1f-2959999e1e30 with identifier: 119053970
2026-01-28 19:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e6f388ad-4892-5338-8f1f-2959999e1e30 with identifier: 119053970 to the API
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e6f388ad-4892-5338-8f1f-2959999e1e30%27 HTTP/1.1" 200 None
2026-01-28 19:04:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e6f388ad-4892-5338-8f1f-2959999e1e30: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119053970?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e6f388ad-4892-5338-8f1f-2959999e1e30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LO69DFK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119053970',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'GLA HATCHBACK',
'odometer': 35652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-10',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Edition Plus 5dr Auto',
'transmission': 'automatic',
'trim': 'GLA 200 AMG Line Edition Plus 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119053970%27 HTTP/1.1" 200 None
2026-01-28 19:04:24 [astonbarclay.gb] INFO: Saving data for 119053970: {'created_time': 1769627064.339828, 'last_price_update_time': 1769627064.339838, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119053970') HTTP/1.1" 204 0
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118890106?view=catalogue)
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118715535?view=catalogue)
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Ff86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fc7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318371fa10>
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Fd02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191af3b10>
2026-01-28 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F54c95cee-fd42-4597-a149-9da0c2a89efd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600 saved to cache
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119027974, 'registration': 'LR69LSY', 'account': 'WBA002', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR Sport [EZ] 5dr DSG', 'mileage': 33330, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-19', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aacd56d7-cd1a-4883-b477-7fe9eee1a7c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119027974, 'registration': 'LR69LSY', 'account': 'WBA002', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR Sport [EZ] 5dr DSG', 'mileage': 33330, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-19', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aacd56d7-cd1a-4883-b477-7fe9eee1a7c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8b24af-7c8c-5d07-88ac-77e29567ebc8 with identifier: 119027974
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8b24af-7c8c-5d07-88ac-77e29567ebc8 with scrape type 1
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ff8b24af-7c8c-5d07-88ac-77e29567ebc8
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ff8b24af-7c8c-5d07-88ac-77e29567ebc8
2026-01-28 19:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ff8b24af-7c8c-5d07-88ac-77e29567ebc8, identifier: 119027974
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119037234, 'registration': 'K50HGM', 'account': 'WBA003', 'make': 'PEUGEOT', 'model': '2008 DIESEL ESTATE', 'derivative': '1.6 BlueHDi 120 Feline 5dr [Mistral]', 'mileage': 102243, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-26', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1560, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**424** VOSA STATES 31K, 39K, 47K, 55K, 67K, 84K, 97K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f16a4701-326c-44c4-b8ca-606536fe93b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119037234, 'registration': 'K50HGM', 'account': 'WBA003', 'make': 'PEUGEOT', 'model': '2008 DIESEL ESTATE', 'derivative': '1.6 BlueHDi 120 Feline 5dr [Mistral]', 'mileage': 102243, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-26', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1560, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600', 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**424** VOSA STATES 31K, 39K, 47K, 55K, 67K, 84K, 97K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f16a4701-326c-44c4-b8ca-606536fe93b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72267623-d555-5831-bd78-17da5b347481 with identifier: 119037234
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72267623-d555-5831-bd78-17da5b347481 with scrape type 1
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118649320, 'registration': 'KM69JGO', 'account': 'DJC003', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 72819, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM69JGO/2026-01-19/image/2e25d799-7ff9-4205-95ef-a2ab2a589a68_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/65f12511-f1c9-476a-ba48-3f296acbc301_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/bcca2e29-7b2c-4ca8-b8a1-3b2e4e675777_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/aac511c8-7d47-4f5a-b5ae-4077276f9f7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/a3fd86d8-ff38-41e3-9c55-b91c6bf7b392_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/d60ca323-ab1c-42df-9617-e915a551cf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/6df1ddf0-e7a3-4030-9979-f78175949a0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/a643a7e6-9daa-4209-a8f8-21974ddb5ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/292fb3a0-966d-44e1-808b-662fa4bef970_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20 - 8K, 09/21 - 18K, 08/22 - 28K, 09/23 - 39K, 10/24 - 55K, 09/25 - 69K', 'remarks': '**105** VOSA STATES 31K, 43K, 55K, 69K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/49c6aeb6-ba8e-44b5-b287-9c7a4deb7ac3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118649320, 'registration': 'KM69JGO', 'account': 'DJC003', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 72819, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM69JGO/2026-01-19/image/2e25d799-7ff9-4205-95ef-a2ab2a589a68_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/65f12511-f1c9-476a-ba48-3f296acbc301_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/bcca2e29-7b2c-4ca8-b8a1-3b2e4e675777_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/aac511c8-7d47-4f5a-b5ae-4077276f9f7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/a3fd86d8-ff38-41e3-9c55-b91c6bf7b392_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/d60ca323-ab1c-42df-9617-e915a551cf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/6df1ddf0-e7a3-4030-9979-f78175949a0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/a643a7e6-9daa-4209-a8f8-21974ddb5ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69JGO/2026-01-19/image/292fb3a0-966d-44e1-808b-662fa4bef970_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20 - 8K, 09/21 - 18K, 08/22 - 28K, 09/23 - 39K, 10/24 - 55K, 09/25 - 69K', 'remarks': '**105** VOSA STATES 31K, 43K, 55K, 69K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/49c6aeb6-ba8e-44b5-b287-9c7a4deb7ac3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with identifier: 118649320
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with scrape type 2
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with scrape type 2
2026-01-28 19:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f5c5038f-f11a-51d8-8b0e-dcd425b62f48, identifier: 118649320
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119029093, 'registration': 'LB21VDK', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e R-Dynamic S 5dr Auto', 'mileage': 33297, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8df7378c-2769-4b2e-8ed9-50173cbf34c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119029093, 'registration': 'LB21VDK', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e R-Dynamic S 5dr Auto', 'mileage': 33297, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8df7378c-2769-4b2e-8ed9-50173cbf34c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f9e6d5-8071-535c-bc14-663a01cabb7d with identifier: 119029093
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f9e6d5-8071-535c-bc14-663a01cabb7d with scrape type 1
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Fd641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119021364, 'registration': 'WG21VUD', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.6 Turbo Ultimate 5dr Auto', 'mileage': 2874, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bbbbc6f-0dbd-4326-ba44-0d3e7d961d6b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119021364, 'registration': 'WG21VUD', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.6 Turbo Ultimate 5dr Auto', 'mileage': 2874, 'mileageWarranty': True, 'type': 'car', 'saleId': 18594, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bbbbc6f-0dbd-4326-ba44-0d3e7d961d6b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2537b645-8c1a-56e9-a85e-f19e8e02be67 with identifier: 119021364
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2537b645-8c1a-56e9-a85e-f19e8e02be67 with scrape type 1
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252Fbb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118827410, 'registration': 'YO18WWF', 'account': 'PR', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 3dr', 'mileage': 63753, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-08-16', 'fuel': 'Petrol', 'motExpiry': '2024-06-10', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YO18WWF/2026-01-21/image/88696142-c19d-48bb-b0df-b35560be9f1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/01a8e7c0-0180-490d-bc36-3bbe9560ce3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/ad74cc05-8fa5-4d7a-94aa-34e5e5755668_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/f666dbe2-4e13-4ed1-acf6-9cfa70600e0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/7cb182f8-d562-4b88-85ef-71e8a29fab89_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/5bb84d69-bd4f-4393-8815-189b822a14e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/0a9c67b0-200d-4e6c-8535-a0c8f67f0818_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/2d683287-3737-4072-8610-00b74332aca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/8f366355-a2ab-4291-bafd-84e456a09377_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1828** VOSA STATES 35K, 53K, 60K SPARE KEY', 'virtual': False, 'seller': 'Private Entry', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9265a36e-eb00-4a82-978b-bf146edbf402.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118827410, 'registration': 'YO18WWF', 'account': 'PR', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 3dr', 'mileage': 63753, 'mileageWarranty': False, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-08-16', 'fuel': 'Petrol', 'motExpiry': '2024-06-10', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YO18WWF/2026-01-21/image/88696142-c19d-48bb-b0df-b35560be9f1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/01a8e7c0-0180-490d-bc36-3bbe9560ce3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/ad74cc05-8fa5-4d7a-94aa-34e5e5755668_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/f666dbe2-4e13-4ed1-acf6-9cfa70600e0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/7cb182f8-d562-4b88-85ef-71e8a29fab89_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/5bb84d69-bd4f-4393-8815-189b822a14e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/0a9c67b0-200d-4e6c-8535-a0c8f67f0818_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/2d683287-3737-4072-8610-00b74332aca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO18WWF/2026-01-21/image/8f366355-a2ab-4291-bafd-84e456a09377_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1828** VOSA STATES 35K, 53K, 60K SPARE KEY', 'virtual': False, 'seller': 'Private Entry', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9265a36e-eb00-4a82-978b-bf146edbf402.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0671349f-f6a0-54e4-b2a3-266707f55121 with identifier: 118827410
2026-01-28 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0671349f-f6a0-54e4-b2a3-266707f55121 with scrape type 2
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0671349f-f6a0-54e4-b2a3-266707f55121 with scrape type 2
2026-01-28 19:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0671349f-f6a0-54e4-b2a3-266707f55121, identifier: 118827410
2026-01-28 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ff8b24af-7c8c-5d07-88ac-77e29567ebc8 with identifier: 119027974
2026-01-28 19:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ff8b24af-7c8c-5d07-88ac-77e29567ebc8 with identifier: 119027974
2026-01-28 19:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ff8b24af-7c8c-5d07-88ac-77e29567ebc8 with identifier: 119027974 to the API
2026-01-28 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ff8b24af-7c8c-5d07-88ac-77e29567ebc8%27 HTTP/1.1" 200 None
2026-01-28 19:04:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ff8b24af-7c8c-5d07-88ac-77e29567ebc8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119027974?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'ORANGE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ff8b24af-7c8c-5d07-88ac-77e29567ebc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR69LSY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119027974',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'SEAT',
'model': 'ARONA HATCHBACK',
'odometer': 33330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-19',
'seller_name': 'UKCGR - Premium',
'title': 'SEAT ARONA HATCHBACK 1.0 TSI 115 FR Sport [EZ] 5dr DSG',
'transmission': 'automatic',
'trim': '1.0 TSI 115 FR Sport [EZ] 5dr DSG',
'vin': None,
'year': 2019}
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119027974%27 HTTP/1.1" 200 None
2026-01-28 19:04:26 [astonbarclay.gb] INFO: Saving data for 119027974: {'created_time': 1769627066.720435, 'last_price_update_time': 1769627066.720445, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119027974') HTTP/1.1" 204 0
2026-01-28 19:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with identifier: 118649320
2026-01-28 19:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with identifier: 118649320
2026-01-28 19:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f5c5038f-f11a-51d8-8b0e-dcd425b62f48 with identifier: 118649320 to the API
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f5c5038f-f11a-51d8-8b0e-dcd425b62f48%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f5c5038f-f11a-51d8-8b0e-dcd425b62f48: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118649320?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': 'f5c5038f-f11a-51d8-8b0e-dcd425b62f48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KM69JGO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118649320',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'PEUGEOT',
'model': '3008 DIESEL ESTATE',
'odometer': 72819,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-11',
'seller_name': 'Cox Motor Group',
'title': 'PEUGEOT 3008 DIESEL ESTATE 1.5 BlueHDi Allure 5dr',
'transmission': 'manual',
'trim': '1.5 BlueHDi Allure 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118649320%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [astonbarclay.gb] INFO: Saving data for 118649320: {'auction_closing_time': 1769774400.0, 'created_time': 1768503760.944432, 'last_price_update_time': 1769627067.021655}
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118649320') HTTP/1.1" 204 0
2026-01-28 19:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0671349f-f6a0-54e4-b2a3-266707f55121 with identifier: 118827410
2026-01-28 19:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0671349f-f6a0-54e4-b2a3-266707f55121 with identifier: 118827410
2026-01-28 19:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0671349f-f6a0-54e4-b2a3-266707f55121 with identifier: 118827410 to the API
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118827410?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': 'RED',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '0671349f-f6a0-54e4-b2a3-266707f55121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YO18WWF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118827410',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 63753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-16',
'seller_name': 'Private Entry',
'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 125 ST-Line 3dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 125 ST-Line 3dr',
'vin': None,
'year': 2018}
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118827410%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [astonbarclay.gb] INFO: Saving data for 118827410: {'auction_closing_time': 1769774400.0, 'created_time': 1769022296.20454, 'last_price_update_time': 1769627067.318595}
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118827410') HTTP/1.1" 204 0
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190484990>
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119089043?view=catalogue)
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Fb81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Ff1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319163d490>
2026-01-28 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Fe4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31906326d0>
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fd3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c0990>
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN74MHK%252F2026-01-22%252Fimage%252Fe28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cef97f1-f10f-5347-9d18-d70c45c94186
2026-01-28 19:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cef97f1-f10f-5347-9d18-d70c45c94186, skipping ID generation
2026-01-28 19:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef97f1-f10f-5347-9d18-d70c45c94186 with scrape type 1
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6cef97f1-f10f-5347-9d18-d70c45c94186 from tracking dictionaries
2026-01-28 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cef97f1-f10f-5347-9d18-d70c45c94186 sending to next pipeline
2026-01-28 19:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6cef97f1-f10f-5347-9d18-d70c45c94186, identifier: 118890106
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191974f10>
2026-01-28 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fa1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190478310>
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX73FEG%252F2026-01-22%252Fimage%252F63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70ca206e-db1b-58a6-9c9f-2af47128980e
2026-01-28 19:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ca206e-db1b-58a6-9c9f-2af47128980e, skipping ID generation
2026-01-28 19:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ca206e-db1b-58a6-9c9f-2af47128980e with scrape type 1
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70ca206e-db1b-58a6-9c9f-2af47128980e from tracking dictionaries
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70ca206e-db1b-58a6-9c9f-2af47128980e sending to next pipeline
2026-01-28 19:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 70ca206e-db1b-58a6-9c9f-2af47128980e, identifier: 118715535
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837f3c90>
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600 saved to cache
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fd3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252Feefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6cef97f1-f10f-5347-9d18-d70c45c94186 with identifier: 118890106
2026-01-28 19:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6cef97f1-f10f-5347-9d18-d70c45c94186 with identifier: 118890106
2026-01-28 19:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life electric estate' containing 'combo'
2026-01-28 19:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6cef97f1-f10f-5347-9d18-d70c45c94186 spider: astonbarclay.gb
2026-01-28 19:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6cef97f1-f10f-5347-9d18-d70c45c94186 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life electric estate' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Electric',
'id': '6cef97f1-f10f-5347-9d18-d70c45c94186',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EN74MHK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118890106',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'COMBO LIFE ELECTRIC ESTATE',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36024,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/5bc6171c-9e20-4a69-847b-c7248ef24161_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34738,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/99f70f94-8f65-4b3a-8cc7-9a961c8dd101_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40907,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/4f606e6e-8363-4c33-a5b0-44f38cbd24d1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37994,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/ce3a28ac-6d06-4673-b588-64e119427b02_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42002,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/406df724-4bfb-48ab-972b-b280f9a6f062_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48201,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/a0104046-b753-4adc-931b-fd70f4138501_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54885,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/d3796c54-a76f-4fe7-a079-d13e56c04031_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef97f1-f10f-5347-9d18-d70c45c94186/6cef97f1-f10f-5347-9d18-d70c45c94186_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40120,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EN74MHK/2026-01-22/image/e28a4c56-a5e6-4214-b4b8-c63e0a01fc07_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-31',
'seller_name': 'Motability Operations',
'title': 'VAUXHALL COMBO LIFE ELECTRIC ESTATE 100kW Ultimate XL 52kWh 5dr '
'Auto',
'transmission': 'automatic',
'trim': '100kW Ultimate XL 52kWh 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118890106%27 HTTP/1.1" 200 None
2026-01-28 19:04:30 [astonbarclay.gb] INFO: Saving data for 118890106: {'created_time': 1769627070.037804, 'last_price_update_time': 1769627070.037814, 'auction_closing_time': 1770631200.0}
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118890106') HTTP/1.1" 204 0
2026-01-28 19:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 70ca206e-db1b-58a6-9c9f-2af47128980e with identifier: 118715535
2026-01-28 19:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 70ca206e-db1b-58a6-9c9f-2af47128980e with identifier: 118715535
2026-01-28 19:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 70ca206e-db1b-58a6-9c9f-2af47128980e with identifier: 118715535 to the API
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-09T10:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '70ca206e-db1b-58a6-9c9f-2af47128980e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EX73FEG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118715535',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 1089,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 4,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27281,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/e46891ee-35b4-47ba-9d9a-191c32026d31_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29452,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/7207a738-9e54-433c-a956-e1b695946ab4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30255,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/5c804604-6236-42b7-b73f-a4c1ce75eb9a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca206e-db1b-58a6-9c9f-2af47128980e/70ca206e-db1b-58a6-9c9f-2af47128980e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29866,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/EX73FEG/2026-01-22/image/63e4ebde-498d-4d9f-8cc6-5ac09c699215_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-20',
'seller_name': 'Motability Operations',
'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Tekna 5dr Auto',
'transmission': 'automatic',
'trim': '1.5 E-Power Tekna 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118715535%27 HTTP/1.1" 200 None
2026-01-28 19:04:30 [astonbarclay.gb] INFO: Saving data for 118715535: {'created_time': 1769627070.37274, 'last_price_update_time': 1769627070.372751, 'auction_closing_time': 1770631200.0}
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118715535') HTTP/1.1" 204 0
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190374750>
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319046b410>
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c27d0>
2026-01-28 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fb0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a1d50>
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS72FKL%252F2026-01-28%252Fimage%252F0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0
2026-01-28 19:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0, skipping ID generation
2026-01-28 19:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with scrape type 1
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 from tracking dictionaries
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 sending to next pipeline
2026-01-28 19:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0, identifier: 119089043
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a0350>
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600 saved to cache
2026-01-28 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with identifier: 119089043
2026-01-28 19:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with identifier: 119089043
2026-01-28 19:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5c4ecd61-de2d-5f46-adb2-ddeab52236a0 with identifier: 119089043 to the API
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '5c4ecd61-de2d-5f46-adb2-ddeab52236a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DS72FKL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119089043',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'FORD',
'model': 'ECOSPORT HATCHBACK',
'odometer': 22008,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35772,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/01718dd6-610a-476d-9ebe-c9d29b77c512_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34962,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/0733cea1-552e-4737-8b4a-236dcd8b3226_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30410,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/98b75aff-c641-49c4-ad36-8bd19b33a4eb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32314,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/608c3f39-004d-4e5e-8301-1aca3628ff19_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39075,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/3d0c86ad-56e1-4a47-b7a5-392877d11475_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31083,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/bfd3d123-3b9a-44aa-b329-b8874a3a9d9c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56730,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/32af0d06-7927-4b22-9f4e-85d9f92be91d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54616,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/d6e0427a-0116-46e1-96f3-585b7b61c9cd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44556,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/864cc448-55fa-4b07-9279-1e5228222430_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34293,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/8a8e7d78-2687-493f-8bf2-2cab61d34d4e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45087,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/6b51523b-6dbc-45cb-8930-99a4f9355e29_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4ecd61-de2d-5f46-adb2-ddeab52236a0/5c4ecd61-de2d-5f46-adb2-ddeab52236a0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41152,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DS72FKL/2026-01-28/image/4ec99d0f-bd98-4b21-9f65-d0cc08ed42f1_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seller_name': 'Motability Operations',
'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 ST-Line 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 125 ST-Line 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119089043%27 HTTP/1.1" 200 None
2026-01-28 19:04:32 [astonbarclay.gb] INFO: Saving data for 119089043: {'created_time': 1769627072.486862, 'last_price_update_time': 1769627072.486873, 'auction_closing_time': 1770114600.0}
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119089043') HTTP/1.1" 204 0
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190204c10>
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Febf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837001d0>
2026-01-28 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183702110>
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600 saved to cache
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Ff6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fe0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183613650>
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252Ff86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837237d0>
2026-01-28 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fc7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fcba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190409f90>
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Fd641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319040b310>
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319043aa50>
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252Fbb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119017250?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118996198?view=catalogue)
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117164114?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948936?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318377c450>
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190237b10>
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901ae3d0>
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Faddef70f-893c-4b50-9e88-d4456293b468.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600 saved to cache
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Ff18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F166435ea-262a-4618-8518-3f838d018e91_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118778553?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118688338?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118527971?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118604329?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118822182?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183671110>
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_10.jpg HTTP/1.1" 201 0
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAD19FOC%252F2026-01-27%252Fimage%252F5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d714e0a6-fcee-5aec-8e4e-19352c6f2883
2026-01-28 19:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d714e0a6-fcee-5aec-8e4e-19352c6f2883, skipping ID generation
2026-01-28 19:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d714e0a6-fcee-5aec-8e4e-19352c6f2883 with scrape type 1
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d714e0a6-fcee-5aec-8e4e-19352c6f2883 from tracking dictionaries
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d714e0a6-fcee-5aec-8e4e-19352c6f2883 sending to next pipeline
2026-01-28 19:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d714e0a6-fcee-5aec-8e4e-19352c6f2883, identifier: 119017250
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190151b90>
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Ff1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183703f10>
2026-01-28 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252Feefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319334b810>
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183670190>
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fd3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901c1a50>
2026-01-28 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919e9c50>
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252F490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837f3250>
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fdcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600 saved to cache
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08
2026-01-28 19:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08, skipping ID generation
2026-01-28 19:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with scrape type 1
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 from tracking dictionaries
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 sending to next pipeline
2026-01-28 19:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08, identifier: 118996198
2026-01-28 19:04:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117164114, 'registration': 'LL69NVE', 'account': 'MOT075', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 82306, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL69NVE/2025-11-12/image/77f54dfd-3ac4-4eb4-981f-87a75ecfe30f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9e8fbe2e-88d5-4722-8ae0-75898dcb8118_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9ca7e8c7-0d3f-416c-80df-38d67e44bde9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/1b5a80ed-7ed4-411e-a8c0-70b7d4d85a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/5d0fc242-d398-47a8-af87-ed920291bf22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/24546ee5-0f80-47bf-91e1-3ca6cbc2b868_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/da10857b-4789-4ece-8a8b-81f90525d16a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/bdb32c0b-dcf9-47ab-a4d5-56b924d32447_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/7e8d004f-c058-47ce-8e0a-25a9e5f01e04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1759**VOSA STATES 53K, 63K, 72K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0d3033c-d08a-4b90-9a8d-7e6229a3fcbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117164114, 'registration': 'LL69NVE', 'account': 'MOT075', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 82306, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL69NVE/2025-11-12/image/77f54dfd-3ac4-4eb4-981f-87a75ecfe30f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9e8fbe2e-88d5-4722-8ae0-75898dcb8118_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9ca7e8c7-0d3f-416c-80df-38d67e44bde9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/1b5a80ed-7ed4-411e-a8c0-70b7d4d85a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/5d0fc242-d398-47a8-af87-ed920291bf22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/24546ee5-0f80-47bf-91e1-3ca6cbc2b868_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/da10857b-4789-4ece-8a8b-81f90525d16a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/bdb32c0b-dcf9-47ab-a4d5-56b924d32447_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/7e8d004f-c058-47ce-8e0a-25a9e5f01e04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1759**VOSA STATES 53K, 63K, 72K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0d3033c-d08a-4b90-9a8d-7e6229a3fcbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2026-01-28 19:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11278895-e52e-5745-88a0-5f3c8b3f6b0b with scrape type 2
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11278895-e52e-5745-88a0-5f3c8b3f6b0b with scrape type 2
2026-01-28 19:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 11278895-e52e-5745-88a0-5f3c8b3f6b0b, identifier: 117164114
2026-01-28 19:04:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118948936, 'registration': 'YA18KCY', 'account': 'WBA002', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.0 Boosterjet SZ-T 5dr', 'mileage': 84787, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-12-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA18KCY/2026-01-23/image/92602e78-f139-456f-b3fb-ab1fd6f60833_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/1c2b4d21-9c4e-46d3-86ff-6ad00c0502aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/92517018-a126-4277-8f8f-1cb3f85343fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/d19dd73c-4903-440a-8e48-a9a1bc3da629_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/70949266-a52c-489c-9165-982d1ade264f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/e0caf5b3-98a9-44aa-ae8e-b6c39dfa78df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/263c0761-e52c-457b-8e21-2e73a12619e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/6418593c-7e0d-4849-a653-2ebbaef2e3f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/4c308c3e-c476-48b9-adc5-15f16fd18dc8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19 - 9K, 05/20 - 16K,', 'remarks': '**582** VOSA STATES 20K, 21K, 37K, 56K, 73K, 83K,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/648c600c-ff2f-4891-af21-574d200ceab1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118948936, 'registration': 'YA18KCY', 'account': 'WBA002', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.0 Boosterjet SZ-T 5dr', 'mileage': 84787, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-12-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA18KCY/2026-01-23/image/92602e78-f139-456f-b3fb-ab1fd6f60833_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/1c2b4d21-9c4e-46d3-86ff-6ad00c0502aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/92517018-a126-4277-8f8f-1cb3f85343fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/d19dd73c-4903-440a-8e48-a9a1bc3da629_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/70949266-a52c-489c-9165-982d1ade264f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/e0caf5b3-98a9-44aa-ae8e-b6c39dfa78df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/263c0761-e52c-457b-8e21-2e73a12619e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/6418593c-7e0d-4849-a653-2ebbaef2e3f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA18KCY/2026-01-23/image/4c308c3e-c476-48b9-adc5-15f16fd18dc8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19 - 9K, 05/20 - 16K,', 'remarks': '**582** VOSA STATES 20K, 21K, 37K, 56K, 73K, 83K,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/648c600c-ff2f-4891-af21-574d200ceab1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86786b18-a805-5be8-8b8d-11bb378c085a with identifier: 118948936
2026-01-28 19:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86786b18-a805-5be8-8b8d-11bb378c085a with scrape type 2
2026-01-28 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86786b18-a805-5be8-8b8d-11bb378c085a with scrape type 2
2026-01-28 19:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 86786b18-a805-5be8-8b8d-11bb378c085a, identifier: 118948936
2026-01-28 19:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d714e0a6-fcee-5aec-8e4e-19352c6f2883 with identifier: 119017250
2026-01-28 19:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d714e0a6-fcee-5aec-8e4e-19352c6f2883 with identifier: 119017250
2026-01-28 19:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d714e0a6-fcee-5aec-8e4e-19352c6f2883 with identifier: 119017250 to the API
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd714e0a6-fcee-5aec-8e4e-19352c6f2883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AD19FOC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119017250',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'BMW',
'model': '5 SERIES DIESEL SALOON',
'odometer': 47370,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37744,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/8d81bc0b-ac0e-4f28-8b9e-0a14db14685d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40210,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5fa37386-ac57-42c5-9120-9bec7bb0574e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37181,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0fb24684-5c6f-43d6-a7ea-18421bd525db_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37559,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/d02fa487-639f-47ed-826c-bb8169b5bfbd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32987,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/e4371a51-b865-4cf0-9e19-85b2128666a0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40112,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/0d1b9147-d5c9-4267-b789-2db4afa282aa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39618,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/3da4e05b-373a-4715-a832-7ae44e2e5a23_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64777,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/ebf0563d-7f4a-4cbe-a78a-bc37a5d41ebd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39558,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/f86f02cd-0873-46ec-b5ee-0702807a5d75_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42643,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/4194a121-f668-48bb-a80c-ac86f2fefc16_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d714e0a6-fcee-5aec-8e4e-19352c6f2883/d714e0a6-fcee-5aec-8e4e-19352c6f2883_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40398,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AD19FOC/2026-01-27/image/5b7710c4-c38b-415b-823c-37ce82d4b0cc_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seller_name': 'UKCGR - Premium',
'title': 'BMW 5 SERIES DIESEL SALOON 530d M Sport 4dr Auto',
'transmission': 'automatic',
'trim': '530d M Sport 4dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119017250%27 HTTP/1.1" 200 None
2026-01-28 19:04:39 [astonbarclay.gb] INFO: Saving data for 119017250: {'created_time': 1769627079.455423, 'last_price_update_time': 1769627079.455435, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119017250') HTTP/1.1" 204 0
2026-01-28 19:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with identifier: 118996198
2026-01-28 19:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with identifier: 118996198
2026-01-28 19:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 66f5d23f-a7c6-53f1-8fcb-f3b991040e08 with identifier: 118996198 to the API
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '66f5d23f-a7c6-53f1-8fcb-f3b991040e08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FM69ZYG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118996198',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS HATCHBACK',
'odometer': 43281,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86039,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/1f687487-4ca1-411a-a90c-bd381aabe807.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55245,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/bd2f7947-d63d-4df3-8549-cfc8514fa56f.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87858,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/0e7eb5ec-e082-4389-8eef-51c956d1af0d.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84231,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/54c95cee-fd42-4597-a149-9da0c2a89efd.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70462,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/17b59340-0ed1-4fa1-aa78-ef00c6c39fae.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75589,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/addef70f-893c-4b50-9e88-d4456293b468.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60502,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/b7f7a8b5-c450-4b58-90da-23b02e2fd0fd.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5d23f-a7c6-53f1-8fcb-f3b991040e08/66f5d23f-a7c6-53f1-8fcb-f3b991040e08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69741,
'Height': 450,
'OriginUrl': 'https://abimg002.imgix.net/dcb0370a-5fc2-40c0-89b7-7aae5533abf2.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-01',
'seller_name': 'Hedin Automotive',
'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 AMG Line 5dr',
'transmission': 'manual',
'trim': 'A180 AMG Line 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118996198%27 HTTP/1.1" 200 None
2026-01-28 19:04:39 [astonbarclay.gb] INFO: Saving data for 118996198: {'created_time': 1769627079.81324, 'last_price_update_time': 1769627079.81325, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118996198') HTTP/1.1" 204 0
2026-01-28 19:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2026-01-28 19:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2026-01-28 19:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114 to the API
2026-01-28 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117164114?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '11278895-e52e-5745-88a0-5f3c8b3f6b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LL69NVE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117164114',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 82306,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seller_name': 'MotoNovo Finance',
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T Tekna 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T Tekna 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2026-01-28 19:04:40 [astonbarclay.gb] INFO: Saving data for 117164114: {'auction_closing_time': 1769774400.0, 'created_time': 1767987473.383925, 'last_price_update_time': 1769627080.15218}
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117164114') HTTP/1.1" 204 0
2026-01-28 19:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 86786b18-a805-5be8-8b8d-11bb378c085a with identifier: 118948936
2026-01-28 19:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 86786b18-a805-5be8-8b8d-11bb378c085a with identifier: 118948936
2026-01-28 19:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 86786b18-a805-5be8-8b8d-11bb378c085a with identifier: 118948936 to the API
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118948936?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '86786b18-a805-5be8-8b8d-11bb378c085a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YA18KCY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948936',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'SUZUKI',
'model': 'SWIFT HATCHBACK',
'odometer': 84787,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': 'UKCGR - Premium',
'title': 'SUZUKI SWIFT HATCHBACK 1.0 Boosterjet SZ-T 5dr',
'transmission': 'manual',
'trim': '1.0 Boosterjet SZ-T 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948936%27 HTTP/1.1" 200 None
2026-01-28 19:04:40 [astonbarclay.gb] INFO: Saving data for 118948936: {'auction_closing_time': 1769774400.0, 'created_time': 1769195102.777168, 'last_price_update_time': 1769627080.715009}
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948936') HTTP/1.1" 204 0
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119034549?view=catalogue)
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fc6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319020a2d0>
2026-01-28 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118778553, 'registration': 'VK16KKU', 'account': 'WBA003', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 ecoFLEX SRi 3dr', 'mileage': 67799, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-09', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK16KKU/2026-01-21/image/005a1689-a5d5-4310-a7d5-06fa55834563_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/db1a20e9-f512-4325-80b7-ac1a45291b1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/adb72de4-1002-413a-8f8c-e59597ffa274_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/f94c13ae-eff3-4b27-8729-2c08ed2e4bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/8c2e4091-a2ad-449e-91c7-8d7613d19099_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/167bb248-a69d-4b20-a5cb-72b1bc7a70f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/9b705630-3cde-4d4d-9e17-c008e2f3ea26_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/cb015c4a-78e9-4731-98f6-a5810073e09e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/729b3af9-64ce-45d1-bbff-3dec099d7438_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/18 - 12K, 11/19 - 26K, 02/22 - 40K', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and **576** VOSA STATES 18K, 27K, 31K, 37K, 46K, 54K, 62K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118778553, 'registration': 'VK16KKU', 'account': 'WBA003', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 ecoFLEX SRi 3dr', 'mileage': 67799, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-09', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK16KKU/2026-01-21/image/005a1689-a5d5-4310-a7d5-06fa55834563_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/db1a20e9-f512-4325-80b7-ac1a45291b1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/adb72de4-1002-413a-8f8c-e59597ffa274_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/f94c13ae-eff3-4b27-8729-2c08ed2e4bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/8c2e4091-a2ad-449e-91c7-8d7613d19099_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/167bb248-a69d-4b20-a5cb-72b1bc7a70f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/9b705630-3cde-4d4d-9e17-c008e2f3ea26_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/cb015c4a-78e9-4731-98f6-a5810073e09e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK16KKU/2026-01-21/image/729b3af9-64ce-45d1-bbff-3dec099d7438_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/18 - 12K, 11/19 - 26K, 02/22 - 40K', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and **576** VOSA STATES 18K, 27K, 31K, 37K, 46K, 54K, 62K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 with identifier: 118778553
2026-01-28 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95, identifier: 118778553
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118688338, 'registration': 'YB67UJP', 'account': 'MOT075', 'make': 'BMW', 'model': '2 SERIES DIESEL ACTIVE TOURER', 'derivative': '220d SE 5dr [Nav] Step Auto', 'mileage': 54617, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-01-17', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB67UJP/2026-01-16/image/1bc8f240-d555-42a6-9eca-39be36456402_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/66940aae-02c7-4dbb-9418-bdb8a09e5b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/9e448072-774d-42f8-a884-a72f7ef7e220_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/be0ceeee-79d2-46ea-a295-ac684001da4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/f11bf31e-8b62-4829-b762-73768404105f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/a572a248-96f9-4ff5-9805-e21be832e53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/37cebd24-c6f7-428b-99d6-a822a444efd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/4cf81763-ef4f-4106-b47c-4be7c0368bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/2bb3cad1-b5ab-435d-a482-8119165e99d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/415c1560-09ad-4dc7-b2ea-bf561d7111cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/9df6955a-d652-4e9b-a4a7-07538779b182_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/19- 13K, 01/21- 19K, 02/22- 26K, 07/23- 35K', 'remarks': 'USED UNRECORDED - N/S DAMAGE 2 KEYS AND HANDBOOKS STARTS AND DRIVES, HPI CLEAR. DESCRIPTION IS A GUIDE ONLY VIEWING RECOMMENDED BY PRIOR ARRANGEMENTS - DELIVERY AVAILABLE - PLEASE CALL **1639** VOSA STATES 19K, 26K, 32K, 38K, 45K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c734259e-1e77-46fb-8c9f-e98c7920e46c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118688338, 'registration': 'YB67UJP', 'account': 'MOT075', 'make': 'BMW', 'model': '2 SERIES DIESEL ACTIVE TOURER', 'derivative': '220d SE 5dr [Nav] Step Auto', 'mileage': 54617, 'mileageWarranty': False, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-01-17', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB67UJP/2026-01-16/image/1bc8f240-d555-42a6-9eca-39be36456402_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/66940aae-02c7-4dbb-9418-bdb8a09e5b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/9e448072-774d-42f8-a884-a72f7ef7e220_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/be0ceeee-79d2-46ea-a295-ac684001da4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/f11bf31e-8b62-4829-b762-73768404105f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/a572a248-96f9-4ff5-9805-e21be832e53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/37cebd24-c6f7-428b-99d6-a822a444efd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/4cf81763-ef4f-4106-b47c-4be7c0368bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/2bb3cad1-b5ab-435d-a482-8119165e99d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/415c1560-09ad-4dc7-b2ea-bf561d7111cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB67UJP/2026-01-16/image/9df6955a-d652-4e9b-a4a7-07538779b182_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/19- 13K, 01/21- 19K, 02/22- 26K, 07/23- 35K', 'remarks': 'USED UNRECORDED - N/S DAMAGE 2 KEYS AND HANDBOOKS STARTS AND DRIVES, HPI CLEAR. DESCRIPTION IS A GUIDE ONLY VIEWING RECOMMENDED BY PRIOR ARRANGEMENTS - DELIVERY AVAILABLE - PLEASE CALL **1639** VOSA STATES 19K, 26K, 32K, 38K, 45K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c734259e-1e77-46fb-8c9f-e98c7920e46c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with identifier: 118688338
2026-01-28 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9deb0fbb-f05a-5094-8117-5f4add9d57a0, identifier: 118688338
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118527971, 'registration': 'HX68TLV', 'account': 'WBA003', 'make': 'ALFA ROMEO', 'model': 'STELVIO ESTATE SPECIAL EDITION', 'derivative': '2.2 D 210 Milano 5dr Auto', 'mileage': 148101, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-11-13', 'fuel': 'Diesel', 'motExpiry': '2026-04-02', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HX68TLV/2026-01-13/image/739e3239-19be-4d07-a19e-6f458c20e11f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/e5c00d91-60c1-467d-9705-98279f83c294_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/1ec3e857-d2a0-46f3-aa16-94f55714d2d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/d3db9ed6-57dc-4ba0-a123-9343e1b98249_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/1bdb9b9c-f772-4682-ba2c-f525d43aa097_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/7e3546d7-1719-4434-b62d-a3617847938c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/8e2e148c-8234-4863-b975-1be48e8683e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/d21cc0f2-0dbb-42cc-b9c3-a5538bac96f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/5c05a42f-abfb-4356-928b-7ab849e741f8_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/19 - 11K, 01/20 - 23K, 01/21 - 30K, 12/21 - 36K, 06/22 - 50K, NO DATE - 64K, 03/23 - 80K, 09/23 - 98K, 02/24 - 112K, 09/24 - 127K, 12/25 - 147K', 'remarks': '**697** VOSA STATES 36K, 68K, 107K, 133K, 139K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ecd07bc-f073-4d90-b1ef-3d3f1e59b7cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118527971, 'registration': 'HX68TLV', 'account': 'WBA003', 'make': 'ALFA ROMEO', 'model': 'STELVIO ESTATE SPECIAL EDITION', 'derivative': '2.2 D 210 Milano 5dr Auto', 'mileage': 148101, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-11-13', 'fuel': 'Diesel', 'motExpiry': '2026-04-02', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HX68TLV/2026-01-13/image/739e3239-19be-4d07-a19e-6f458c20e11f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/e5c00d91-60c1-467d-9705-98279f83c294_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/1ec3e857-d2a0-46f3-aa16-94f55714d2d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/d3db9ed6-57dc-4ba0-a123-9343e1b98249_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/1bdb9b9c-f772-4682-ba2c-f525d43aa097_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/7e3546d7-1719-4434-b62d-a3617847938c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/8e2e148c-8234-4863-b975-1be48e8683e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/d21cc0f2-0dbb-42cc-b9c3-a5538bac96f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX68TLV/2026-01-13/image/5c05a42f-abfb-4356-928b-7ab849e741f8_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/19 - 11K, 01/20 - 23K, 01/21 - 30K, 12/21 - 36K, 06/22 - 50K, NO DATE - 64K, 03/23 - 80K, 09/23 - 98K, 02/24 - 112K, 09/24 - 127K, 12/25 - 147K', 'remarks': '**697** VOSA STATES 36K, 68K, 107K, 133K, 139K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ecd07bc-f073-4d90-b1ef-3d3f1e59b7cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc with identifier: 118527971
2026-01-28 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc, identifier: 118527971
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118604329, 'registration': 'WJ66LPY', 'account': 'WBA002', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Prime 2dr Auto', 'mileage': 16540, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol', 'motExpiry': '2026-06-08', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/5495afdf-fb9a-4868-ad1a-fc1dceb9f54b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/e532ddc6-39ae-4cfe-89a7-5a0bb0594399_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/feafe814-01d5-4c94-8750-11c65377abfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/dbe02aec-1048-49c8-ad52-5e48ed84cdac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/ba1c0b0f-d970-4f2c-ad97-ea5809ac4ce1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/e17bbb0a-4857-49e5-bc40-165026c07fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/da2f838f-f231-43ed-952f-34e77b6a77d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/f2e2b4a9-a257-40ac-b2fd-dd7ae14ceb57_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/17 - 3K, 05/22 - 12K, 12/22 - 13K, 06/23 - 13K, 05/25 - 15K', 'remarks': '**560** VOSA STATES 8K, 10K, 10K, 12K, 13K, 15K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/38b5c5fd-8c29-4a3e-9131-3f6d9df37461.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118604329, 'registration': 'WJ66LPY', 'account': 'WBA002', 'make': 'SMART', 'model': 'FORTWO COUPE', 'derivative': '1.0 Prime 2dr Auto', 'mileage': 16540, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol', 'motExpiry': '2026-06-08', 'doors': 2, 'engineSize': 999, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/5495afdf-fb9a-4868-ad1a-fc1dceb9f54b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/e532ddc6-39ae-4cfe-89a7-5a0bb0594399_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/feafe814-01d5-4c94-8750-11c65377abfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/dbe02aec-1048-49c8-ad52-5e48ed84cdac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/ba1c0b0f-d970-4f2c-ad97-ea5809ac4ce1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/e17bbb0a-4857-49e5-bc40-165026c07fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/da2f838f-f231-43ed-952f-34e77b6a77d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ66LPY/2026-01-14/image/f2e2b4a9-a257-40ac-b2fd-dd7ae14ceb57_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/17 - 3K, 05/22 - 12K, 12/22 - 13K, 06/23 - 13K, 05/25 - 15K', 'remarks': '**560** VOSA STATES 8K, 10K, 10K, 12K, 13K, 15K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/38b5c5fd-8c29-4a3e-9131-3f6d9df37461.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254e57ba-b6ca-52b8-b258-53f6393b72fd with identifier: 118604329
2026-01-28 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254e57ba-b6ca-52b8-b258-53f6393b72fd with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254e57ba-b6ca-52b8-b258-53f6393b72fd with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 254e57ba-b6ca-52b8-b258-53f6393b72fd, identifier: 118604329
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118822182, 'registration': 'BC17LBO', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.5 dCi Tekna 5dr', 'mileage': 104113, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-07-15', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BC17LBO/2026-01-22/image/1ca392bc-64f8-4f64-8ee8-fabfae5fd946_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/c15f05dc-acba-4a6e-8b42-9f4baa1117a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/06f701e2-021f-4ea0-9b85-6782808d7806_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/01db98ba-750c-45df-86f9-86b1c0e4f9a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/4da04a27-19b9-4345-9434-bbaef5941172_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/19aef5a5-137e-4bd7-b1c6-f3f5e613250d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/78f7e95d-bc21-4b17-8908-d4488459b251_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/38c48b0d-5963-4d1c-9452-ac56cb46bdcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/c2195e47-7de0-4429-a6ec-f3a087e6ecc2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/24 - NO MILEAGE, 06/25 - 96K', 'remarks': '**694** VOSA STATES 44K, 50K, 60K, 72K, 85K, 97K, SD CARD, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1ccd5dc-c5d9-493a-9267-592bbe30bc2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118822182, 'registration': 'BC17LBO', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.5 dCi Tekna 5dr', 'mileage': 104113, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-07-15', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BC17LBO/2026-01-22/image/1ca392bc-64f8-4f64-8ee8-fabfae5fd946_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/c15f05dc-acba-4a6e-8b42-9f4baa1117a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/06f701e2-021f-4ea0-9b85-6782808d7806_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/01db98ba-750c-45df-86f9-86b1c0e4f9a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/4da04a27-19b9-4345-9434-bbaef5941172_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/19aef5a5-137e-4bd7-b1c6-f3f5e613250d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/78f7e95d-bc21-4b17-8908-d4488459b251_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/38c48b0d-5963-4d1c-9452-ac56cb46bdcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BC17LBO/2026-01-22/image/c2195e47-7de0-4429-a6ec-f3a087e6ecc2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/24 - NO MILEAGE, 06/25 - 96K', 'remarks': '**694** VOSA STATES 44K, 50K, 60K, 72K, 85K, 97K, SD CARD, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1ccd5dc-c5d9-493a-9267-592bbe30bc2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 with identifier: 118822182
2026-01-28 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 with scrape type 2
2026-01-28 19:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6, identifier: 118822182
2026-01-28 19:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 with identifier: 118778553
2026-01-28 19:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 with identifier: 118778553
2026-01-28 19:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 spider: astonbarclay.gb
2026-01-28 19:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3b9bd4e9-507d-5a6a-b86c-230a09b17b95 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '3b9bd4e9-507d-5a6a-b86c-230a09b17b95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VK16KKU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118778553',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VAUXHALL',
'model': 'CORSA HATCHBACK',
'odometer': 67799,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-09',
'seller_name': 'UKCGR - Select',
'title': 'VAUXHALL CORSA HATCHBACK 1.4 ecoFLEX SRi 3dr',
'transmission': 'manual',
'trim': '1.4 ecoFLEX SRi 3dr',
'vin': None,
'year': 2016}
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118778553%27 HTTP/1.1" 200 None
2026-01-28 19:04:41 [astonbarclay.gb] INFO: Saving data for 118778553: {'auction_closing_time': 1769774400.0, 'created_time': 1768936518.815086, 'last_price_update_time': 1769627081.878636}
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118778553') HTTP/1.1" 204 0
2026-01-28 19:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with identifier: 118688338
2026-01-28 19:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with identifier: 118688338
2026-01-28 19:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9deb0fbb-f05a-5094-8117-5f4add9d57a0 with identifier: 118688338 to the API
2026-01-28 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118688338?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '9deb0fbb-f05a-5094-8117-5f4add9d57a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YB67UJP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118688338',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'BMW',
'model': '2 SERIES DIESEL ACTIVE TOURER',
'odometer': 54617,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-17',
'seller_name': 'MotoNovo Finance',
'title': 'BMW 2 SERIES DIESEL ACTIVE TOURER 220d SE 5dr [Nav] Step Auto',
'transmission': 'automatic',
'trim': '220d SE 5dr [Nav] Step Auto',
'vin': None,
'year': 2018}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118688338%27 HTTP/1.1" 200 None
2026-01-28 19:04:42 [astonbarclay.gb] INFO: Saving data for 118688338: {'auction_closing_time': 1769774400.0, 'created_time': 1768590975.773243, 'last_price_update_time': 1769627082.178426}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118688338') HTTP/1.1" 204 0
2026-01-28 19:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc with identifier: 118527971
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc with identifier: 118527971
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'alfa romeo stelvio estate special edition 2.2 d 210 milano 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'alfa romeo', 'model': 'stelvio estate special edition', 'transmission': 'automatic', 'engine': '2.1l', 'fuel_type': 'diesel', 'odometer': 148101, 'odometer_reading_unit': 'mi', 'registration_date': '2018-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118527971', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.2 d 210 milano 5dr auto', 'license_plate': 'hx68tlv', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 149, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '11a7064c-f5f0-525b-a763-0eeb4a2fc1dc', 'current_year_diff': 8, 'age_in_months': 86, 'make_model': 'alfa romeo stelvio estate special edition', 'sanitized_make': 'alfaromeo', 'odometer_in_km': 238344}
Failed validating None in schema:
False
On instance:
{'age_in_months': 86,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.1l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '11a7064c-f5f0-525b-a763-0eeb4a2fc1dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'hx68tlv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118527971',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'alfa romeo',
'make_model': 'alfa romeo stelvio estate special edition',
'model': 'stelvio estate special edition',
'odometer': 148101,
'odometer_in_km': 238344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-13',
'sanitized_make': 'alfaromeo',
'seller_name': 'ukcgr - select',
'title': 'alfa romeo stelvio estate special edition 2.2 d 210 milano '
'5dr auto',
'transmission': 'automatic',
'trim': '2.2 d 210 milano 5dr auto',
'vin': None,
'year': 2018}
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc spider: astonbarclay.gb
2026-01-28 19:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 11a7064c-f5f0-525b-a763-0eeb4a2fc1dc due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'alfa romeo stelvio estate special edition 2.2 d 210 milano 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'alfa romeo', 'model': 'stelvio estate special edition', 'transmission': 'automatic', 'engine': '2.1l', 'fuel_type': 'diesel', 'odometer': 148101, 'odometer_reading_unit': 'mi', 'registration_date': '2018-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118527971', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.2 d 210 milano 5dr auto', 'license_plate': 'hx68tlv', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 149, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '11a7064c-f5f0-525b-a763-0eeb4a2fc1dc', 'current_year_diff': 8, 'age_in_months': 86, 'make_model': 'alfa romeo stelvio estate special edition', 'sanitized_make': 'alfaromeo', 'odometer_in_km': 238344}
Failed validating None in schema:
False
On instance:
{'age_in_months': 86,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'red',
'currency': 'gbp',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.1l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '11a7064c-f5f0-525b-a763-0eeb4a2fc1dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'hx68tlv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118527971',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'alfa romeo',
'make_model': 'alfa romeo stelvio estate special edition',
'model': 'stelvio estate special edition',
'odometer': 148101,
'odometer_in_km': 238344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-13',
'sanitized_make': 'alfaromeo',
'seller_name': 'ukcgr - select',
'title': 'alfa romeo stelvio estate special edition 2.2 d 210 milano '
'5dr auto',
'transmission': 'automatic',
'trim': '2.2 d 210 milano 5dr auto',
'vin': None,
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '11a7064c-f5f0-525b-a763-0eeb4a2fc1dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'HX68TLV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118527971',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'ALFA ROMEO',
'model': 'STELVIO ESTATE SPECIAL EDITION',
'odometer': 148101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-13',
'seller_name': 'UKCGR - Select',
'title': 'ALFA ROMEO STELVIO ESTATE SPECIAL EDITION 2.2 D 210 Milano 5dr Auto',
'transmission': 'automatic',
'trim': '2.2 D 210 Milano 5dr Auto',
'vin': None,
'year': 2018}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118527971%27 HTTP/1.1" 200 None
2026-01-28 19:04:42 [astonbarclay.gb] INFO: Saving data for 118527971: {'auction_closing_time': 1769774400.0, 'created_time': 1768244634.267, 'last_price_update_time': 1769627082.404531}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118527971') HTTP/1.1" 204 0
2026-01-28 19:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 254e57ba-b6ca-52b8-b258-53f6393b72fd with identifier: 118604329
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 254e57ba-b6ca-52b8-b258-53f6393b72fd with identifier: 118604329
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 254e57ba-b6ca-52b8-b258-53f6393b72fd spider: astonbarclay.gb
2026-01-28 19:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 254e57ba-b6ca-52b8-b258-53f6393b72fd due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '254e57ba-b6ca-52b8-b258-53f6393b72fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WJ66LPY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118604329',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'SMART',
'model': 'FORTWO COUPE',
'odometer': 16540,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seller_name': 'UKCGR - Premium',
'title': 'SMART FORTWO COUPE 1.0 Prime 2dr Auto',
'transmission': 'automatic',
'trim': '1.0 Prime 2dr Auto',
'vin': None,
'year': 2016}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118604329%27 HTTP/1.1" 200 None
2026-01-28 19:04:42 [astonbarclay.gb] INFO: Saving data for 118604329: {'auction_closing_time': 1769774400.0, 'created_time': 1768417562.831032, 'last_price_update_time': 1769627082.629187}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118604329') HTTP/1.1" 204 0
2026-01-28 19:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 with identifier: 118822182
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 with identifier: 118822182
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167553 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167553
2026-01-28 19:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 spider: astonbarclay.gb
2026-01-28 19:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6 due to rule: high_mileage_for_country.json, error: 167553 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167553
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': 'b80bbc51-7969-5bc7-8a36-bfc78ddc3dc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BC17LBO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118822182',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'NISSAN',
'model': 'QASHQAI DIESEL HATCHBACK',
'odometer': 104113,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seller_name': 'UKCGR - Select',
'title': 'NISSAN QASHQAI DIESEL HATCHBACK 1.5 dCi Tekna 5dr',
'transmission': 'manual',
'trim': '1.5 dCi Tekna 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118822182%27 HTTP/1.1" 200 None
2026-01-28 19:04:42 [astonbarclay.gb] INFO: Saving data for 118822182: {'auction_closing_time': 1769774400.0, 'created_time': 1769022332.849942, 'last_price_update_time': 1769627082.842746}
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118822182') HTTP/1.1" 204 0
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837366d0>
2026-01-28 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fe0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3193d3eb90>
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191642810>
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902987d0>
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bb9d0>
2026-01-28 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Ff6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190298a90>
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Fb81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903bae90>
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190299610>
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSA22MHE%252F2026-01-28%252Fimage%252Fcba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc
2026-01-28 19:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7371390-31d0-5f87-b367-1d6dc5ff4bfc, skipping ID generation
2026-01-28 19:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc with scrape type 1
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7371390-31d0-5f87-b367-1d6dc5ff4bfc from tracking dictionaries
2026-01-28 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7371390-31d0-5f87-b367-1d6dc5ff4bfc sending to next pipeline
2026-01-28 19:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b7371390-31d0-5f87-b367-1d6dc5ff4bfc, identifier: 119034549
2026-01-28 19:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b7371390-31d0-5f87-b367-1d6dc5ff4bfc with identifier: 119034549
2026-01-28 19:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b7371390-31d0-5f87-b367-1d6dc5ff4bfc with identifier: 119034549
2026-01-28 19:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b7371390-31d0-5f87-b367-1d6dc5ff4bfc with identifier: 119034549 to the API
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b7371390-31d0-5f87-b367-1d6dc5ff4bfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SA22MHE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119034549',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'B CLASS HATCHBACK SPECIAL EDITIONS',
'odometer': 64635,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39730,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/ca1ec0a6-4d28-4d95-aa68-acc733819603_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41597,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/a1082c65-f3a6-4ce9-b299-34bda4bdb15c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38970,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/b0e13547-a6d4-494d-8d4f-2adbe12c1955_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41665,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/68e018c8-e09c-4106-8c9b-6e435dae06cd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45970,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/c7e964d5-633d-4417-9c61-3527a3138797_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43848,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/03fbccd8-cd0d-46dc-be2f-7d3f96e225e7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37273,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f1af4a3c-59c8-41a1-b176-a0cdeac314f6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54896,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/490a1bf6-0e19-4343-9fa0-a80ca0010c8c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48015,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/f6bb6b1f-32ce-42de-87e0-e530c110055c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7371390-31d0-5f87-b367-1d6dc5ff4bfc/b7371390-31d0-5f87-b367-1d6dc5ff4bfc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51028,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/SA22MHE/2026-01-28/image/cba594ac-e9fe-4160-9ca9-de9ad1f77f32_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-24',
'seller_name': 'UKCGR - Premium',
'title': 'MERCEDES-BENZ B CLASS HATCHBACK SPECIAL EDITIONS B200 AMG Line '
'Premium Edition 5dr Auto',
'transmission': 'automatic',
'trim': 'B200 AMG Line Premium Edition 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119034549%27 HTTP/1.1" 200 None
2026-01-28 19:04:45 [astonbarclay.gb] INFO: Saving data for 119034549: {'created_time': 1769627085.459525, 'last_price_update_time': 1769627085.459536, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119034549') HTTP/1.1" 204 0
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119029093?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119037234?view=catalogue)
2026-01-28 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119021364?view=catalogue)
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905164d0>
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190386dd0>
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F166435ea-262a-4618-8518-3f838d018e91_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190332490>
2026-01-28 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252Ff18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190198a90>
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191878a10>
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190120d50>
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190331110>
2026-01-28 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190387210>
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119091175?view=catalogue)
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916ada90>
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190468cd0>
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318366c510>
2026-01-28 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902c7c90>
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028f810>
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252F84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318361cc10>
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB21VDK%252F2026-01-28%252Fimage%252F08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46f9e6d5-8071-535c-bc14-663a01cabb7d
2026-01-28 19:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46f9e6d5-8071-535c-bc14-663a01cabb7d, skipping ID generation
2026-01-28 19:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f9e6d5-8071-535c-bc14-663a01cabb7d with scrape type 1
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46f9e6d5-8071-535c-bc14-663a01cabb7d from tracking dictionaries
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46f9e6d5-8071-535c-bc14-663a01cabb7d sending to next pipeline
2026-01-28 19:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46f9e6d5-8071-535c-bc14-663a01cabb7d, identifier: 119029093
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009c4d0>
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FK50HGM%252F2026-01-28%252Fimage%252Fc6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72267623-d555-5831-bd78-17da5b347481
2026-01-28 19:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72267623-d555-5831-bd78-17da5b347481, skipping ID generation
2026-01-28 19:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72267623-d555-5831-bd78-17da5b347481 with scrape type 1
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 72267623-d555-5831-bd78-17da5b347481 from tracking dictionaries
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72267623-d555-5831-bd78-17da5b347481 sending to next pipeline
2026-01-28 19:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 72267623-d555-5831-bd78-17da5b347481, identifier: 119037234
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319009c4d0>
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG21VUD%252F2026-01-28%252Fimage%252F4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2537b645-8c1a-56e9-a85e-f19e8e02be67
2026-01-28 19:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2537b645-8c1a-56e9-a85e-f19e8e02be67, skipping ID generation
2026-01-28 19:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2537b645-8c1a-56e9-a85e-f19e8e02be67 with scrape type 1
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2537b645-8c1a-56e9-a85e-f19e8e02be67 from tracking dictionaries
2026-01-28 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2537b645-8c1a-56e9-a85e-f19e8e02be67 sending to next pipeline
2026-01-28 19:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2537b645-8c1a-56e9-a85e-f19e8e02be67, identifier: 119021364
2026-01-28 19:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46f9e6d5-8071-535c-bc14-663a01cabb7d with identifier: 119029093
2026-01-28 19:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46f9e6d5-8071-535c-bc14-663a01cabb7d with identifier: 119029093
2026-01-28 19:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46f9e6d5-8071-535c-bc14-663a01cabb7d with identifier: 119029093 to the API
2026-01-28 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 44,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '46f9e6d5-8071-535c-bc14-663a01cabb7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LB21VDK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119029093',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE HATCHBACK',
'odometer': 33297,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34101,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/d641b831-b6f3-4064-a482-db88f49361ee_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36076,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/b81acc7d-86e0-4d20-aa87-a654100b7c5e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33424,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/90fb078a-fb43-4d0a-87c4-f8ef105890f5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32563,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/86ff6ad7-116c-4623-9716-78aee98ef657_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56744,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/55b3aaf5-0fca-47a4-a971-9f237c07502e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49136,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/2374567a-96c4-4365-9d7b-9e6d2c2f6d07_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37273,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/f18a75d1-2068-4428-91d7-c36c231b1959_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37521,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/97239cdb-69c5-4f88-8062-11a9a8d6073d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f9e6d5-8071-535c-bc14-663a01cabb7d/46f9e6d5-8071-535c-bc14-663a01cabb7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28846,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LB21VDK/2026-01-28/image/08e60593-baa7-4494-b601-ddf0f0eb05a3_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-16',
'seller_name': 'UKCGR - Premium',
'title': 'LAND ROVER RANGE ROVER EVOQUE HATCHBACK 1.5 P300e R-Dynamic S 5dr '
'Auto',
'transmission': 'automatic',
'trim': '1.5 P300e R-Dynamic S 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119029093%27 HTTP/1.1" 200 None
2026-01-28 19:04:51 [astonbarclay.gb] INFO: Saving data for 119029093: {'created_time': 1769627091.234733, 'last_price_update_time': 1769627091.234745, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119029093') HTTP/1.1" 204 0
2026-01-28 19:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 72267623-d555-5831-bd78-17da5b347481 with identifier: 119037234
2026-01-28 19:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 72267623-d555-5831-bd78-17da5b347481 with identifier: 119037234
2026-01-28 19:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164543 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164543
2026-01-28 19:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 72267623-d555-5831-bd78-17da5b347481 spider: astonbarclay.gb
2026-01-28 19:04:51 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 72267623-d555-5831-bd78-17da5b347481 due to rule: high_mileage_for_country.json, error: 164543 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164543
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '72267623-d555-5831-bd78-17da5b347481',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'K50HGM',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119037234',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'PEUGEOT',
'model': '2008 DIESEL ESTATE',
'odometer': 102243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27728,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/5eaecb8b-f13f-46cb-b98e-6ea6dc202ef3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26343,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/014ae8e4-3475-41c1-82aa-3de46271c8c7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24738,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/d3c9bf61-6f15-48c0-a213-7c4c3835801c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26127,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/1ddb84cf-e510-4ab6-8bae-630d297fdf2b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45470,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/e0e79f04-8107-4190-9734-e6d77b46e621_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59068,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/6b6e347a-4a44-4cfe-b9be-85218d36c8f2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44950,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/84742435-ea18-47a7-b09b-7dee832af252_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56970,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/098a64c0-accb-4f60-a03a-3cb8a72bfb63_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72267623-d555-5831-bd78-17da5b347481/72267623-d555-5831-bd78-17da5b347481_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51606,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/K50HGM/2026-01-28/image/c6f4cbd4-031b-488b-a050-dec3cdd46737_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-26',
'seller_name': 'UKCGR - Select',
'title': 'PEUGEOT 2008 DIESEL ESTATE 1.6 BlueHDi 120 Feline 5dr [Mistral]',
'transmission': 'manual',
'trim': '1.6 BlueHDi 120 Feline 5dr [Mistral]',
'vin': None,
'year': 2016}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119037234%27 HTTP/1.1" 200 None
2026-01-28 19:04:51 [astonbarclay.gb] INFO: Saving data for 119037234: {'created_time': 1769627091.471895, 'last_price_update_time': 1769627091.471905, 'auction_closing_time': 1770123600.0}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119037234') HTTP/1.1" 204 0
2026-01-28 19:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2537b645-8c1a-56e9-a85e-f19e8e02be67 with identifier: 119021364
2026-01-28 19:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2537b645-8c1a-56e9-a85e-f19e8e02be67 with identifier: 119021364
2026-01-28 19:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2537b645-8c1a-56e9-a85e-f19e8e02be67 with identifier: 119021364 to the API
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-02-04T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2537b645-8c1a-56e9-a85e-f19e8e02be67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WG21VUD',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119021364',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'GRANDLAND X HATCHBACK',
'odometer': 2874,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42404,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/bb157365-0c6d-480c-9981-fdfbe625ed3c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44766,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/54b3bf42-f8bb-429f-a98c-692c6f8b1ef6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37442,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/eefacd75-717a-4e67-a309-76286c99d00f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40755,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/7dc4c1c7-c9d7-4bb0-a717-7120e73d71a5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52232,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/1c91baa5-e1ba-4e5d-87ac-31ca728497aa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54945,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/89cd29d2-a2c4-48f6-80bd-5029a89b3f38_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43385,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/166435ea-262a-4618-8518-3f838d018e91_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42771,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/141af5e6-49f0-4f0b-9ad1-65139374d55d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2537b645-8c1a-56e9-a85e-f19e8e02be67/2537b645-8c1a-56e9-a85e-f19e8e02be67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34306,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WG21VUD/2026-01-28/image/4e125097-52a1-46c9-adf7-6a4186f023ef_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seller_name': 'UKCGR - Premium',
'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.6 Turbo Ultimate 5dr Auto',
'transmission': 'automatic',
'trim': '1.6 Turbo Ultimate 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119021364%27 HTTP/1.1" 200 None
2026-01-28 19:04:51 [astonbarclay.gb] INFO: Saving data for 119021364: {'created_time': 1769627091.846965, 'last_price_update_time': 1769627091.846977, 'auction_closing_time': 1770199200.0}
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119021364') HTTP/1.1" 204 0
2026-01-28 19:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118804823?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118956491?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118948660?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118576221?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190287ad0>
2026-01-28 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190287950>
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fbb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901afa90>
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fb93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a2dc10>
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252F00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a2850>
2026-01-28 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWV18UVB%252F2026-01-28%252Fimage%252Fc31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26f2638d-528a-5989-b49b-901759dfca90
2026-01-28 19:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26f2638d-528a-5989-b49b-901759dfca90, skipping ID generation
2026-01-28 19:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f2638d-528a-5989-b49b-901759dfca90 with scrape type 1
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 26f2638d-528a-5989-b49b-901759dfca90 from tracking dictionaries
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26f2638d-528a-5989-b49b-901759dfca90 sending to next pipeline
2026-01-28 19:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 26f2638d-528a-5989-b49b-901759dfca90, identifier: 119091175
2026-01-28 19:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 26f2638d-528a-5989-b49b-901759dfca90 with identifier: 119091175
2026-01-28 19:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 26f2638d-528a-5989-b49b-901759dfca90 with identifier: 119091175
2026-01-28 19:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 26f2638d-528a-5989-b49b-901759dfca90 with identifier: 119091175 to the API
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': '26f2638d-528a-5989-b49b-901759dfca90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WV18UVB',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119091175',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VAUXHALL',
'model': 'CORSA HATCHBACK',
'odometer': 75498,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37808,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/b93499e9-bc9f-4c21-97f4-8dc50b1f6b74_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39831,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/c31ddfea-587d-42c3-b751-8ee2dd21fb7f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29135,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/00d17dfe-1e8a-4bfc-87d4-ce74973d441a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30315,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/bb41d20c-0dc2-4fc5-b1aa-7e97fb85de52_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56327,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ff5499c1-f4bb-4455-a6bb-c2689af8b8fd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44104,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/39ead3a7-a5c8-4df7-b3fa-ebb07c19c367_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43463,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/ec46e938-b1b9-4c95-a449-19a1be0f4d9c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f2638d-528a-5989-b49b-901759dfca90/26f2638d-528a-5989-b49b-901759dfca90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30156,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WV18UVB/2026-01-28/image/1e45499d-8dcb-4b11-bbef-aa6c57af2a39_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': 'CarGiant',
'title': 'VAUXHALL CORSA HATCHBACK 1.4 SRi Vx-line 5dr',
'transmission': 'manual',
'trim': '1.4 SRi Vx-line 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091175%27 HTTP/1.1" 200 None
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Saving data for 119091175: {'created_time': 1769627093.690919, 'last_price_update_time': 1769627093.69093, 'auction_closing_time': 1770053400.0}
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119091175') HTTP/1.1" 204 0
2026-01-28 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118571721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118585498?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118603823?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119086318?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118804823, 'registration': 'NY19EAP', 'account': 'WBA002', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo 126 SR 5dr', 'mileage': 92708, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-14', 'fuel': 'Petrol', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NY19EAP/2026-01-22/image/91c3325c-c567-482b-a772-5869b30acf45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/9ea0ca5b-c1a2-4310-a5ec-a1a08505ac28_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/d606d4b3-5b98-42c2-9848-9b9721ab3a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/3e85d94e-bdcb-44f8-ad9d-7c05d25de1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/4418347f-8b5f-4492-b3d9-93789ce83dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/2d61a553-27ae-4240-9e07-6067c4544240_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/38220d64-ce05-4127-b40b-1acf5fd8cb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/f17b5ef3-bc47-4238-bae7-1c4739a6e0b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/0b7b01ca-6052-4a79-847a-282ddc368068_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/20- 13K, 02/21- 20K, 10/21- 30K, 02/22- 37K, 06/22- 45K, 09/22- 50K, 04/23- 63K, 10/23- 73K, 08/24- 81K, 06/25- 88K, 09/25- 90K', 'remarks': '**611**VOSA STATES 45K, 67K, 80K, 88K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecc508fb-3f30-4543-bee5-fa54581e45dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118804823, 'registration': 'NY19EAP', 'account': 'WBA002', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo 126 SR 5dr', 'mileage': 92708, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-14', 'fuel': 'Petrol', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NY19EAP/2026-01-22/image/91c3325c-c567-482b-a772-5869b30acf45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/9ea0ca5b-c1a2-4310-a5ec-a1a08505ac28_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/d606d4b3-5b98-42c2-9848-9b9721ab3a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/3e85d94e-bdcb-44f8-ad9d-7c05d25de1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/4418347f-8b5f-4492-b3d9-93789ce83dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/2d61a553-27ae-4240-9e07-6067c4544240_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/38220d64-ce05-4127-b40b-1acf5fd8cb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/f17b5ef3-bc47-4238-bae7-1c4739a6e0b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY19EAP/2026-01-22/image/0b7b01ca-6052-4a79-847a-282ddc368068_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/20- 13K, 02/21- 20K, 10/21- 30K, 02/22- 37K, 06/22- 45K, 09/22- 50K, 04/23- 63K, 10/23- 73K, 08/24- 81K, 06/25- 88K, 09/25- 90K', 'remarks': '**611**VOSA STATES 45K, 67K, 80K, 88K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecc508fb-3f30-4543-bee5-fa54581e45dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a461b8c-33f0-5757-9853-975ffd656968 with identifier: 118804823
2026-01-28 19:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a461b8c-33f0-5757-9853-975ffd656968 with scrape type 2
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a461b8c-33f0-5757-9853-975ffd656968 with scrape type 2
2026-01-28 19:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5a461b8c-33f0-5757-9853-975ffd656968, identifier: 118804823
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118956491, 'registration': 'KO66NWV', 'account': 'WBA004', 'make': 'VOLVO', 'model': 'S90 DIESEL SALOON', 'derivative': '2.0 D5 PowerPulse Inscription 4dr AWD Geartronic', 'mileage': 169068, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-01-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-06', 'doors': 4, 'engineSize': 1969, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO66NWV/2026-01-27/image/d57d775d-53b7-47bd-abff-8fbb26197f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/06f86e91-358d-427b-94ee-9ad1e8130726_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/19433520-1b00-4c18-be0a-88b2a8bfd1e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/77139c0c-07ec-4c5f-a52e-ac354422cf8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/2c211efd-696e-468c-a92d-0cccf1ff5e5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/b31fa8ac-c2cd-4bb5-a211-394c1e4dbcde_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/ea92b211-3626-4e06-8f4f-95f88c5d670d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/e68abea9-e9f4-4864-86e9-a2a8a77627ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/87eb6f7b-b684-4fe5-8aa1-ebf61adebe20_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/17-8K, 12/18-27K, 11/19-48K, 12/20-69K, 11/21-86K, 11/22-102K, 11/23-121K, 11/24-142K, 10/25-169K,', 'remarks': '**430** VOSA STATES 52K, 69K, 86K, 102K, 121K, 142K, 164K,', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33240fe6-5e13-4c2a-9184-2d6dbf0eaf02.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118956491, 'registration': 'KO66NWV', 'account': 'WBA004', 'make': 'VOLVO', 'model': 'S90 DIESEL SALOON', 'derivative': '2.0 D5 PowerPulse Inscription 4dr AWD Geartronic', 'mileage': 169068, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-01-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-06', 'doors': 4, 'engineSize': 1969, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO66NWV/2026-01-27/image/d57d775d-53b7-47bd-abff-8fbb26197f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/06f86e91-358d-427b-94ee-9ad1e8130726_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/19433520-1b00-4c18-be0a-88b2a8bfd1e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/77139c0c-07ec-4c5f-a52e-ac354422cf8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/2c211efd-696e-468c-a92d-0cccf1ff5e5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/b31fa8ac-c2cd-4bb5-a211-394c1e4dbcde_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/ea92b211-3626-4e06-8f4f-95f88c5d670d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/e68abea9-e9f4-4864-86e9-a2a8a77627ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO66NWV/2026-01-27/image/87eb6f7b-b684-4fe5-8aa1-ebf61adebe20_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/17-8K, 12/18-27K, 11/19-48K, 12/20-69K, 11/21-86K, 11/22-102K, 11/23-121K, 11/24-142K, 10/25-169K,', 'remarks': '**430** VOSA STATES 52K, 69K, 86K, 102K, 121K, 142K, 164K,', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33240fe6-5e13-4c2a-9184-2d6dbf0eaf02.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 472f24d3-11d6-5ea0-b332-e438dc212708 with identifier: 118956491
2026-01-28 19:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 472f24d3-11d6-5ea0-b332-e438dc212708 with scrape type 2
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 472f24d3-11d6-5ea0-b332-e438dc212708 with scrape type 2
2026-01-28 19:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 472f24d3-11d6-5ea0-b332-e438dc212708, identifier: 118956491
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118948660, 'registration': 'PL20BAU', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 D180 R-Dynamic SE 5dr Auto', 'mileage': 45095, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-03', 'fuel': 'Diesel', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/PL20BAU/2026-01-28/image/c513cdf3-d153-4e62-8c35-2450ebc74d4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/b62e0aca-6d5a-4ebe-8c09-8f83d9720cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/57588f1f-156e-4956-99dd-4d683dbe35e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/2f21f253-73f5-45fa-87f9-3231c0534f8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/9f11899e-c059-496e-985a-66b3e205bb72_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/f8ebe1b3-f962-4b26-a1a4-ddfd80aaf477_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/f76d88f2-0044-463d-a86c-b40925d7ad87_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/e4105a1a-27d9-433b-bd02-51bf4ed322b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/a89e7159-3299-49fa-9cb8-a71f7870800c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21- 3K', 'remarks': '**86**VOSA STATES 7K, 19K, 31K, 42K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40e12ead-de09-4471-801b-b7bcae2bb4d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118948660, 'registration': 'PL20BAU', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 D180 R-Dynamic SE 5dr Auto', 'mileage': 45095, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-02-03T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-03', 'fuel': 'Diesel', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/PL20BAU/2026-01-28/image/c513cdf3-d153-4e62-8c35-2450ebc74d4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/b62e0aca-6d5a-4ebe-8c09-8f83d9720cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/57588f1f-156e-4956-99dd-4d683dbe35e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/2f21f253-73f5-45fa-87f9-3231c0534f8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/9f11899e-c059-496e-985a-66b3e205bb72_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/f8ebe1b3-f962-4b26-a1a4-ddfd80aaf477_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/f76d88f2-0044-463d-a86c-b40925d7ad87_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/e4105a1a-27d9-433b-bd02-51bf4ed322b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL20BAU/2026-01-28/image/a89e7159-3299-49fa-9cb8-a71f7870800c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21- 3K', 'remarks': '**86**VOSA STATES 7K, 19K, 31K, 42K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40e12ead-de09-4471-801b-b7bcae2bb4d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6374fdef-b977-5e47-b790-569c510528a8 with identifier: 118948660
2026-01-28 19:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6374fdef-b977-5e47-b790-569c510528a8 with scrape type 2
2026-01-28 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6374fdef-b977-5e47-b790-569c510528a8 with scrape type 2
2026-01-28 19:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6374fdef-b977-5e47-b790-569c510528a8, identifier: 118948660
2026-01-28 19:04:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118576221, 'registration': 'WV69AWY', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 100 Zetec 5dr', 'mileage': 76350, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV69AWY/2026-01-14/image/6757bc9d-b66e-4f3f-a6ed-3aab5eae273f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/db2d9f6c-596c-492c-999f-d8cca7262947_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/be92feb5-c19b-4d4d-9ede-9d635aab61e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/5a758204-b00e-44cb-bfee-f15c7e2d7123_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/5530a5a1-b47e-4262-9201-10841e349099_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/27afeaf4-e303-435f-b605-295264cb59c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/1e4b5d0c-1e10-44c2-a743-29cfd0c8b208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/3e859afc-eea1-4474-9100-9f5c6dc5b52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/00969c55-3f4a-4e1f-a178-7b4554ed4605_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/21 - NO MILEAGE, 12/24 - 67K', 'remarks': '**633** VOSA STATES 37K, 61K, 71K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/305c0c44-4383-42f3-8240-f8d0de2c68c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118576221, 'registration': 'WV69AWY', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 100 Zetec 5dr', 'mileage': 76350, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV69AWY/2026-01-14/image/6757bc9d-b66e-4f3f-a6ed-3aab5eae273f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/db2d9f6c-596c-492c-999f-d8cca7262947_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/be92feb5-c19b-4d4d-9ede-9d635aab61e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/5a758204-b00e-44cb-bfee-f15c7e2d7123_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/5530a5a1-b47e-4262-9201-10841e349099_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/27afeaf4-e303-435f-b605-295264cb59c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/1e4b5d0c-1e10-44c2-a743-29cfd0c8b208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/3e859afc-eea1-4474-9100-9f5c6dc5b52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV69AWY/2026-01-14/image/00969c55-3f4a-4e1f-a178-7b4554ed4605_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/21 - NO MILEAGE, 12/24 - 67K', 'remarks': '**633** VOSA STATES 37K, 61K, 71K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/305c0c44-4383-42f3-8240-f8d0de2c68c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94b2917-d06a-5063-bd98-8944131d0ed2 with identifier: 118576221
2026-01-28 19:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94b2917-d06a-5063-bd98-8944131d0ed2 with scrape type 2
2026-01-28 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94b2917-d06a-5063-bd98-8944131d0ed2 with scrape type 2
2026-01-28 19:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b94b2917-d06a-5063-bd98-8944131d0ed2, identifier: 118576221
2026-01-28 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5a461b8c-33f0-5757-9853-975ffd656968 with identifier: 118804823
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5a461b8c-33f0-5757-9853-975ffd656968 with identifier: 118804823
2026-01-28 19:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5a461b8c-33f0-5757-9853-975ffd656968 with identifier: 118804823 to the API
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118804823?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '5a461b8c-33f0-5757-9853-975ffd656968',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'NY19EAP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118804823',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'HONDA',
'model': 'CIVIC HATCHBACK',
'odometer': 92708,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-14',
'seller_name': 'UKCGR - Premium',
'title': 'HONDA CIVIC HATCHBACK 1.0 VTEC Turbo 126 SR 5dr',
'transmission': 'manual',
'trim': '1.0 VTEC Turbo 126 SR 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118804823%27 HTTP/1.1" 200 None
2026-01-28 19:04:54 [astonbarclay.gb] INFO: Saving data for 118804823: {'auction_closing_time': 1769774400.0, 'created_time': 1768936514.01486, 'last_price_update_time': 1769627094.470395}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118804823') HTTP/1.1" 204 0
2026-01-28 19:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 472f24d3-11d6-5ea0-b332-e438dc212708 with identifier: 118956491
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 472f24d3-11d6-5ea0-b332-e438dc212708 with identifier: 118956491
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'volvo s90 diesel saloon 2.0 d5 powerpulse inscription 4dr awd geartronic', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 's90 diesel saloon', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 169068, 'odometer_reading_unit': 'mi', 'registration_date': '2017-01-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118956491', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.0 d5 powerpulse inscription 4dr awd geartronic', 'license_plate': 'ko66nwv', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': 127, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '472f24d3-11d6-5ea0-b332-e438dc212708', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'volvo s90 diesel saloon', 'sanitized_make': 'volvo', 'odometer_in_km': 272087}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 4,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '472f24d3-11d6-5ea0-b332-e438dc212708',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ko66nwv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118956491',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'volvo',
'make_model': 'volvo s90 diesel saloon',
'model': 's90 diesel saloon',
'odometer': 169068,
'odometer_in_km': 272087,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-30',
'sanitized_make': 'volvo',
'seller_name': 'ukcgr - trade',
'title': 'volvo s90 diesel saloon 2.0 d5 powerpulse inscription 4dr '
'awd geartronic',
'transmission': 'automatic',
'trim': '2.0 d5 powerpulse inscription 4dr awd geartronic',
'vin': None,
'year': 2017}
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 472f24d3-11d6-5ea0-b332-e438dc212708 spider: astonbarclay.gb
2026-01-28 19:04:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 472f24d3-11d6-5ea0-b332-e438dc212708 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'volvo s90 diesel saloon 2.0 d5 powerpulse inscription 4dr awd geartronic', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 's90 diesel saloon', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 169068, 'odometer_reading_unit': 'mi', 'registration_date': '2017-01-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118956491', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.0 d5 powerpulse inscription 4dr awd geartronic', 'license_plate': 'ko66nwv', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': 127, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '472f24d3-11d6-5ea0-b332-e438dc212708', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'volvo s90 diesel saloon', 'sanitized_make': 'volvo', 'odometer_in_km': 272087}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 4,
'emission_standard': 'euro 6',
'engine': '2.0l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '472f24d3-11d6-5ea0-b332-e438dc212708',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'ko66nwv',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118956491',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'volvo',
'make_model': 'volvo s90 diesel saloon',
'model': 's90 diesel saloon',
'odometer': 169068,
'odometer_in_km': 272087,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-30',
'sanitized_make': 'volvo',
'seller_name': 'ukcgr - trade',
'title': 'volvo s90 diesel saloon 2.0 d5 powerpulse inscription 4dr '
'awd geartronic',
'transmission': 'automatic',
'trim': '2.0 d5 powerpulse inscription 4dr awd geartronic',
'vin': None,
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '472f24d3-11d6-5ea0-b332-e438dc212708',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KO66NWV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118956491',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VOLVO',
'model': 'S90 DIESEL SALOON',
'odometer': 169068,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-30',
'seller_name': 'UKCGR - Trade',
'title': 'VOLVO S90 DIESEL SALOON 2.0 D5 PowerPulse Inscription 4dr AWD '
'Geartronic',
'transmission': 'automatic',
'trim': '2.0 D5 PowerPulse Inscription 4dr AWD Geartronic',
'vin': None,
'year': 2017}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118956491%27 HTTP/1.1" 200 None
2026-01-28 19:04:54 [astonbarclay.gb] INFO: Saving data for 118956491: {'auction_closing_time': 1769774400.0, 'created_time': 1769281382.213875, 'last_price_update_time': 1769627094.679616}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118956491') HTTP/1.1" 204 0
2026-01-28 19:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6374fdef-b977-5e47-b790-569c510528a8 with identifier: 118948660
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6374fdef-b977-5e47-b790-569c510528a8 with identifier: 118948660
2026-01-28 19:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6374fdef-b977-5e47-b790-569c510528a8 with identifier: 118948660 to the API
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276374fdef-b977-5e47-b790-569c510528a8%27 HTTP/1.1" 200 None
2026-01-28 19:04:54 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6374fdef-b977-5e47-b790-569c510528a8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118948660?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T13:00:00Z',
'fuel_type': 'Diesel',
'id': '6374fdef-b977-5e47-b790-569c510528a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'PL20BAU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118948660',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT DIESEL SW',
'odometer': 45095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seller_name': 'Hatfields Group',
'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 D180 R-Dynamic SE 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 D180 R-Dynamic SE 5dr Auto',
'vin': None,
'year': 2020}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118948660%27 HTTP/1.1" 200 None
2026-01-28 19:04:54 [astonbarclay.gb] INFO: Saving data for 118948660: {'auction_closing_time': 1770123600.0, 'created_time': 1769195011.76879, 'last_price_update_time': 1769627094.973031}
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118948660') HTTP/1.1" 204 0
2026-01-28 19:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b94b2917-d06a-5063-bd98-8944131d0ed2 with identifier: 118576221
2026-01-28 19:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b94b2917-d06a-5063-bd98-8944131d0ed2 with identifier: 118576221
2026-01-28 19:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b94b2917-d06a-5063-bd98-8944131d0ed2 with identifier: 118576221 to the API
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b94b2917-d06a-5063-bd98-8944131d0ed2%27 HTTP/1.1" 200 None
2026-01-28 19:04:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b94b2917-d06a-5063-bd98-8944131d0ed2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118576221?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': 'b94b2917-d06a-5063-bd98-8944131d0ed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WV69AWY',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118576221',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'FOCUS HATCHBACK',
'odometer': 76350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-10',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 100 Zetec 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 100 Zetec 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118576221%27 HTTP/1.1" 200 None
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Saving data for 118576221: {'auction_closing_time': 1769774400.0, 'created_time': 1768331671.997865, 'last_price_update_time': 1769627095.266719}
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118576221') HTTP/1.1" 204 0
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118571721, 'registration': 'BK67ZVW', 'account': 'WBA004', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 159457, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-09-26', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/a9e76f22-b6be-48e8-99dc-6ff5c3154cb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/a7fc7fdf-764a-4592-9805-59b5843fb9e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/816ca9cf-e515-4ef0-a217-adf47aa67ea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/03baf3d0-0be5-43c2-adc8-d258b9be6c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/cbead01b-0b2f-4951-beb9-a53711d1267f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/8c8035a1-9895-4dc6-b2ef-8b07f8f7e00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/70fa2de7-8a21-49b5-8132-e93f19a9468f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/d0c5c250-a1f4-49d0-89ee-6285e2b6564c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18 - 20K, 04/19 - 29K, 08/19 - 40K, 12/19 - 49K, 07/20 - 61K, 04/22 - 100K, 09/22 - 110K, 04/23 - 120K, 11/23 - 130K, 04/24 - 140K, 12/24 - 150K', 'remarks': '**665** VOSA STATES 63K, 83K, 110K, 127K, 147K, 155K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/08b69ab1-9e55-47d5-a840-d8accc0390b4.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118571721, 'registration': 'BK67ZVW', 'account': 'WBA004', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 159457, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-09-26', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/a9e76f22-b6be-48e8-99dc-6ff5c3154cb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/a7fc7fdf-764a-4592-9805-59b5843fb9e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/816ca9cf-e515-4ef0-a217-adf47aa67ea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/03baf3d0-0be5-43c2-adc8-d258b9be6c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/cbead01b-0b2f-4951-beb9-a53711d1267f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/8c8035a1-9895-4dc6-b2ef-8b07f8f7e00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/70fa2de7-8a21-49b5-8132-e93f19a9468f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK67ZVW/2026-01-14/image/d0c5c250-a1f4-49d0-89ee-6285e2b6564c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18 - 20K, 04/19 - 29K, 08/19 - 40K, 12/19 - 49K, 07/20 - 61K, 04/22 - 100K, 09/22 - 110K, 04/23 - 120K, 11/23 - 130K, 04/24 - 140K, 12/24 - 150K', 'remarks': '**665** VOSA STATES 63K, 83K, 110K, 127K, 147K, 155K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/08b69ab1-9e55-47d5-a840-d8accc0390b4.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4fe72f-63f3-5d23-8868-ff0d932e648a with identifier: 118571721
2026-01-28 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4fe72f-63f3-5d23-8868-ff0d932e648a with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e4fe72f-63f3-5d23-8868-ff0d932e648a with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e4fe72f-63f3-5d23-8868-ff0d932e648a, identifier: 118571721
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118585498, 'registration': 'DK19SYF', 'account': 'WBA004', 'make': 'HONDA', 'model': 'CIVIC DIESEL HATCHBACK', 'derivative': '1.6 i-DTEC SR 5dr', 'mileage': 124897, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-04', 'fuel': 'Diesel', 'motExpiry': '2027-01-28', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK19SYF/2026-01-15/image/7e660460-f87c-4a99-bc65-12a895fcb784_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/c4e2e853-7563-4455-9f5a-88bf1715b350_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/88e2ccde-990d-4cf8-b475-9871ffae775a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/319f0970-9c9a-42bf-a9f3-cb9d96fb1bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/8f8e968f-339d-405f-842c-84b138af5e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/3d442571-aa22-4544-be3b-9e4dc2f5dc3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/ad829d78-9363-49ec-b14f-f07d113e64f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/4a05edfa-baf4-4a93-8d05-3ceca393f214_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/55ccea7a-ae7b-4126-9534-4515975722b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/19 - 12K, 10/19 - 25K, 01/20 - 35K, 09/20 - 48K, 06/21 - 60K, 10/21 - 74K, 01/22 - 88K, 04/22 - 99K, 01/25 - 116K', 'remarks': '**587** VOSA STATES 90K, 115K, 116K, 116K, 124K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 93, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f23e1a2d-2382-4325-af6d-6f150e5760d7.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118585498, 'registration': 'DK19SYF', 'account': 'WBA004', 'make': 'HONDA', 'model': 'CIVIC DIESEL HATCHBACK', 'derivative': '1.6 i-DTEC SR 5dr', 'mileage': 124897, 'mileageWarranty': True, 'type': 'car', 'saleId': 18421, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-04', 'fuel': 'Diesel', 'motExpiry': '2027-01-28', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK19SYF/2026-01-15/image/7e660460-f87c-4a99-bc65-12a895fcb784_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/c4e2e853-7563-4455-9f5a-88bf1715b350_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/88e2ccde-990d-4cf8-b475-9871ffae775a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/319f0970-9c9a-42bf-a9f3-cb9d96fb1bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/8f8e968f-339d-405f-842c-84b138af5e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/3d442571-aa22-4544-be3b-9e4dc2f5dc3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/ad829d78-9363-49ec-b14f-f07d113e64f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/4a05edfa-baf4-4a93-8d05-3ceca393f214_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK19SYF/2026-01-15/image/55ccea7a-ae7b-4126-9534-4515975722b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/19 - 12K, 10/19 - 25K, 01/20 - 35K, 09/20 - 48K, 06/21 - 60K, 10/21 - 74K, 01/22 - 88K, 04/22 - 99K, 01/25 - 116K', 'remarks': '**587** VOSA STATES 90K, 115K, 116K, 116K, 124K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 93, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f23e1a2d-2382-4325-af6d-6f150e5760d7.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 with identifier: 118585498
2026-01-28 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8, identifier: 118585498
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118603823, 'registration': 'AO21JZN', 'account': 'KTL001', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 48V 118 3 5dr', 'mileage': 67137, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO21JZN/2026-01-15/image/37c56d80-cc87-43d6-a9d5-042b8c8568f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/a0f5db55-ca0e-47f0-af4d-02c1fcb6f32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/d5e10218-10bb-414f-9e5d-71c09d26a99c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/c59072a8-bb0e-48d3-9eb2-f55674dfc5d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/39a4f439-d227-4e4a-806f-85637426e6b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/930fae8b-2b9e-4385-9206-933b3e427c3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/693486f4-e726-44fc-80bb-b5dbe0dbbf09_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/018be5bd-b445-4103-8225-4f72a52c48fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/fb0a0b58-857f-4eec-ab5e-8a27f24e4ccb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/22-20K, 08/23-46K, 04/24-58K, 02/25-65K,', 'remarks': '**1932** VOSA STATES 58K, 66K', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/889d2317-7027-4742-ae82-05c8252b621c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118603823, 'registration': 'AO21JZN', 'account': 'KTL001', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 48V 118 3 5dr', 'mileage': 67137, 'mileageWarranty': True, 'type': 'car', 'saleId': 18422, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2027-01-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO21JZN/2026-01-15/image/37c56d80-cc87-43d6-a9d5-042b8c8568f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/a0f5db55-ca0e-47f0-af4d-02c1fcb6f32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/d5e10218-10bb-414f-9e5d-71c09d26a99c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/c59072a8-bb0e-48d3-9eb2-f55674dfc5d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/39a4f439-d227-4e4a-806f-85637426e6b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/930fae8b-2b9e-4385-9206-933b3e427c3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/693486f4-e726-44fc-80bb-b5dbe0dbbf09_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/018be5bd-b445-4103-8225-4f72a52c48fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO21JZN/2026-01-15/image/fb0a0b58-857f-4eec-ab5e-8a27f24e4ccb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/22-20K, 08/23-46K, 04/24-58K, 02/25-65K,', 'remarks': '**1932** VOSA STATES 58K, 66K', 'virtual': False, 'seller': 'Kia Specialist', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/889d2317-7027-4742-ae82-05c8252b621c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2edcfe-4050-525e-bece-3676ad04c013 with identifier: 118603823
2026-01-28 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2edcfe-4050-525e-bece-3676ad04c013 with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e2edcfe-4050-525e-bece-3676ad04c013 with scrape type 2
2026-01-28 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1e2edcfe-4050-525e-bece-3676ad04c013, identifier: 118603823
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119086318, 'registration': 'GF72JVN', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 54956, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119086318, 'registration': 'GF72JVN', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 54956, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b743a67-7fac-5400-bfa4-f329c913b82b with identifier: 119086318
2026-01-28 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b743a67-7fac-5400-bfa4-f329c913b82b with scrape type 1
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2b743a67-7fac-5400-bfa4-f329c913b82b
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2b743a67-7fac-5400-bfa4-f329c913b82b
2026-01-28 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2b743a67-7fac-5400-bfa4-f329c913b82b, identifier: 119086318
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900be710>
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Ff30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191673590>
2026-01-28 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fb06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190104e10>
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fd4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e4fe72f-63f3-5d23-8868-ff0d932e648a with identifier: 118571721
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e4fe72f-63f3-5d23-8868-ff0d932e648a with identifier: 118571721
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'toyota rav4 estate 2.5 vvt-i hybrid excel tss 5dr cvt', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'rav4 estate', 'transmission': 'automatic', 'engine': '2.5l', 'fuel_type': 'petrol/electric hybrid', 'odometer': 159457, 'odometer_reading_unit': 'mi', 'registration_date': '2017-09-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118571721', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.5 vvt-i hybrid excel tss 5dr cvt', 'license_plate': 'bk67zvw', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 118, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9e4fe72f-63f3-5d23-8868-ff0d932e648a', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'toyota rav4 estate', 'sanitized_make': 'toyota', 'odometer_in_km': 256620}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.5l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'petrol/electric hybrid',
'id': '9e4fe72f-63f3-5d23-8868-ff0d932e648a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'bk67zvw',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118571721',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'toyota',
'make_model': 'toyota rav4 estate',
'model': 'rav4 estate',
'odometer': 159457,
'odometer_in_km': 256620,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'sanitized_make': 'toyota',
'seller_name': 'ukcgr - trade',
'title': 'toyota rav4 estate 2.5 vvt-i hybrid excel tss 5dr cvt',
'transmission': 'automatic',
'trim': '2.5 vvt-i hybrid excel tss 5dr cvt',
'vin': None,
'year': 2017}
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9e4fe72f-63f3-5d23-8868-ff0d932e648a spider: astonbarclay.gb
2026-01-28 19:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9e4fe72f-63f3-5d23-8868-ff0d932e648a due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'toyota rav4 estate 2.5 vvt-i hybrid excel tss 5dr cvt', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'rav4 estate', 'transmission': 'automatic', 'engine': '2.5l', 'fuel_type': 'petrol/electric hybrid', 'odometer': 159457, 'odometer_reading_unit': 'mi', 'registration_date': '2017-09-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118571721', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '2.5 vvt-i hybrid excel tss 5dr cvt', 'license_plate': 'bk67zvw', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 118, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9e4fe72f-63f3-5d23-8868-ff0d932e648a', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'toyota rav4 estate', 'sanitized_make': 'toyota', 'odometer_in_km': 256620}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '2.5l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'petrol/electric hybrid',
'id': '9e4fe72f-63f3-5d23-8868-ff0d932e648a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'bk67zvw',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118571721',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'toyota',
'make_model': 'toyota rav4 estate',
'model': 'rav4 estate',
'odometer': 159457,
'odometer_in_km': 256620,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'sanitized_make': 'toyota',
'seller_name': 'ukcgr - trade',
'title': 'toyota rav4 estate 2.5 vvt-i hybrid excel tss 5dr cvt',
'transmission': 'automatic',
'trim': '2.5 vvt-i hybrid excel tss 5dr cvt',
'vin': None,
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '9e4fe72f-63f3-5d23-8868-ff0d932e648a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BK67ZVW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118571721',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'TOYOTA',
'model': 'RAV4 ESTATE',
'odometer': 159457,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': 'UKCGR - Trade',
'title': 'TOYOTA RAV4 ESTATE 2.5 VVT-i Hybrid Excel TSS 5dr CVT',
'transmission': 'automatic',
'trim': '2.5 VVT-i Hybrid Excel TSS 5dr CVT',
'vin': None,
'year': 2017}
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118571721%27 HTTP/1.1" 200 None
2026-01-28 19:04:56 [astonbarclay.gb] INFO: Saving data for 118571721: {'auction_closing_time': 1769774400.0, 'created_time': 1768417624.459458, 'last_price_update_time': 1769627096.65283}
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118571721') HTTP/1.1" 204 0
2026-01-28 19:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 with identifier: 118585498
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 with identifier: 118585498
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'honda civic diesel hatchback 1.6 i-dtec sr 5dr', 'price': 0, 'currency': 'gbp', 'make': 'honda', 'model': 'civic diesel hatchback', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 124897, 'odometer_reading_unit': 'mi', 'registration_date': '2019-03-04', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118585498', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 i-dtec sr 5dr', 'license_plate': 'dk19syf', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 93, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5c0ac0e3-ca08-5a3b-836d-048a286e45d8', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'honda civic diesel hatchback', 'sanitized_make': 'honda', 'odometer_in_km': 201001}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '5c0ac0e3-ca08-5a3b-836d-048a286e45d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'dk19syf',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118585498',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'honda',
'make_model': 'honda civic diesel hatchback',
'model': 'civic diesel hatchback',
'odometer': 124897,
'odometer_in_km': 201001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'sanitized_make': 'honda',
'seller_name': 'ukcgr - trade',
'title': 'honda civic diesel hatchback 1.6 i-dtec sr 5dr',
'transmission': 'manual',
'trim': '1.6 i-dtec sr 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 spider: astonbarclay.gb
2026-01-28 19:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5c0ac0e3-ca08-5a3b-836d-048a286e45d8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'ukcgr - trade', 'price_includes_vat': False, 'title': 'honda civic diesel hatchback 1.6 i-dtec sr 5dr', 'price': 0, 'currency': 'gbp', 'make': 'honda', 'model': 'civic diesel hatchback', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 124897, 'odometer_reading_unit': 'mi', 'registration_date': '2019-03-04', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118585498', 'expiration_date': '2026-01-30t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 i-dtec sr 5dr', 'license_plate': 'dk19syf', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 93, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5c0ac0e3-ca08-5a3b-836d-048a286e45d8', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'honda civic diesel hatchback', 'sanitized_make': 'honda', 'odometer_in_km': 201001}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'white',
'currency': 'gbp',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'expiration_date': '2026-01-30t12:00:00z',
'fuel_type': 'diesel',
'id': '5c0ac0e3-ca08-5a3b-836d-048a286e45d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'dk19syf',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118585498',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'honda',
'make_model': 'honda civic diesel hatchback',
'model': 'civic diesel hatchback',
'odometer': 124897,
'odometer_in_km': 201001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'sanitized_make': 'honda',
'seller_name': 'ukcgr - trade',
'title': 'honda civic diesel hatchback 1.6 i-dtec sr 5dr',
'transmission': 'manual',
'trim': '1.6 i-dtec sr 5dr',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '5c0ac0e3-ca08-5a3b-836d-048a286e45d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DK19SYF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118585498',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'HONDA',
'model': 'CIVIC DIESEL HATCHBACK',
'odometer': 124897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'seller_name': 'UKCGR - Trade',
'title': 'HONDA CIVIC DIESEL HATCHBACK 1.6 i-DTEC SR 5dr',
'transmission': 'manual',
'trim': '1.6 i-DTEC SR 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118585498%27 HTTP/1.1" 200 None
2026-01-28 19:04:56 [astonbarclay.gb] INFO: Saving data for 118585498: {'auction_closing_time': 1769774400.0, 'created_time': 1768417499.36164, 'last_price_update_time': 1769627096.865835}
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118585498') HTTP/1.1" 204 0
2026-01-28 19:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1e2edcfe-4050-525e-bece-3676ad04c013 with identifier: 118603823
2026-01-28 19:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1e2edcfe-4050-525e-bece-3676ad04c013 with identifier: 118603823
2026-01-28 19:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1e2edcfe-4050-525e-bece-3676ad04c013 with identifier: 118603823 to the API
2026-01-28 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271e2edcfe-4050-525e-bece-3676ad04c013%27 HTTP/1.1" 200 None
2026-01-28 19:04:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1e2edcfe-4050-525e-bece-3676ad04c013: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118603823?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '1e2edcfe-4050-525e-bece-3676ad04c013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'AO21JZN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118603823',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'KIA',
'model': 'RIO HATCHBACK',
'odometer': 67137,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seller_name': 'Kia Specialist',
'title': 'KIA RIO HATCHBACK 1.0 T GDi 48V 118 3 5dr',
'transmission': 'manual',
'trim': '1.0 T GDi 48V 118 3 5dr',
'vin': None,
'year': 2021}
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118603823%27 HTTP/1.1" 200 None
2026-01-28 19:04:57 [astonbarclay.gb] INFO: Saving data for 118603823: {'auction_closing_time': 1769774400.0, 'created_time': 1768417499.89229, 'last_price_update_time': 1769627097.154687}
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118603823') HTTP/1.1" 204 0
2026-01-28 19:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2b743a67-7fac-5400-bfa4-f329c913b82b with identifier: 119086318
2026-01-28 19:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2b743a67-7fac-5400-bfa4-f329c913b82b with identifier: 119086318
2026-01-28 19:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2b743a67-7fac-5400-bfa4-f329c913b82b with identifier: 119086318 to the API
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272b743a67-7fac-5400-bfa4-f329c913b82b%27 HTTP/1.1" 200 None
2026-01-28 19:04:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2b743a67-7fac-5400-bfa4-f329c913b82b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119086318?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '2b743a67-7fac-5400-bfa4-f329c913b82b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'GF72JVN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119086318',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 54956,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-16',
'seller_name': 'Motability Operations',
'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power N-Connecta 5dr Auto',
'transmission': 'automatic',
'trim': '1.5 E-Power N-Connecta 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119086318%27 HTTP/1.1" 200 None
2026-01-28 19:04:57 [astonbarclay.gb] INFO: Saving data for 119086318: {'created_time': 1769627097.456619, 'last_price_update_time': 1769627097.45663, 'auction_closing_time': 1770114600.0}
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119086318') HTTP/1.1" 204 0
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118654422?view=catalogue)
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118775449?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119099408?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118556340?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119016033?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190cfbf90>
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fde3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902da790>
2026-01-28 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252Fa978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31918afe90>
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252F3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3193016090>
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDN22XWV%252F2026-01-22%252Fimage%252F5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600 saved to cache
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 044f1413-6fad-5d88-a24a-84f4f36bc672
2026-01-28 19:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 044f1413-6fad-5d88-a24a-84f4f36bc672, skipping ID generation
2026-01-28 19:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044f1413-6fad-5d88-a24a-84f4f36bc672 with scrape type 1
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 044f1413-6fad-5d88-a24a-84f4f36bc672 from tracking dictionaries
2026-01-28 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 044f1413-6fad-5d88-a24a-84f4f36bc672 sending to next pipeline
2026-01-28 19:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 044f1413-6fad-5d88-a24a-84f4f36bc672, identifier: 118654422
2026-01-28 19:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 044f1413-6fad-5d88-a24a-84f4f36bc672 with identifier: 118654422
2026-01-28 19:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 044f1413-6fad-5d88-a24a-84f4f36bc672 with identifier: 118654422
2026-01-28 19:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 044f1413-6fad-5d88-a24a-84f4f36bc672 with identifier: 118654422 to the API
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '044f1413-6fad-5d88-a24a-84f4f36bc672',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DN22XWV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118654422',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 36618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32040,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b4fbdbf3-a5f0-4687-94f7-74aaf434200f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31991,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/5e8a307b-417e-4cd1-825e-2a92a8997816_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30925,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/3e9d2b32-b490-4b2e-bd28-47549ea2523a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29421,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/a978432c-4d8b-4fd6-83e7-47ce5f145e37_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48796,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/de3b20a3-d1fc-46d4-a722-867b2bed2f02_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43993,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/d4342d67-493f-4c7e-a644-7364e7db01e9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54038,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/f30cb2bb-479b-44a6-a5dc-c13d6c532acd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044f1413-6fad-5d88-a24a-84f4f36bc672/044f1413-6fad-5d88-a24a-84f4f36bc672_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52167,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/DN22XWV/2026-01-22/image/b06f414e-5265-4d5c-8737-9419462c28a7_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-31',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654422%27 HTTP/1.1" 200 None
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Saving data for 118654422: {'created_time': 1769627099.249768, 'last_price_update_time': 1769627099.249779, 'auction_closing_time': 1769680800.0}
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118654422') HTTP/1.1" 204 0
2026-01-28 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118775449, 'registration': 'EO24NUP', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10263, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-04-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO24NUP/2026-01-22/image/fe5c8360-3946-4621-8a8a-5a3705c07282_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/f658e4cf-575f-4a05-b7c1-3f6e6eec1bf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/8bb8680d-a0d0-4593-bc52-db5a61de2503_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/641f7c16-7de2-46f4-8ae9-86d3c08dcff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/3eb7a01d-5703-4937-8535-aa85fdd60cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/d2ffcc94-1e52-4292-a36e-c9bd8c69a477_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/44ee6110-e1f5-4bc8-9bca-6557d312bd32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/25-6k,', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e0cc06b-ea1c-498f-ba3c-bceb8359757f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118775449, 'registration': 'EO24NUP', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10263, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-04-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO24NUP/2026-01-22/image/fe5c8360-3946-4621-8a8a-5a3705c07282_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/f658e4cf-575f-4a05-b7c1-3f6e6eec1bf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/8bb8680d-a0d0-4593-bc52-db5a61de2503_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/641f7c16-7de2-46f4-8ae9-86d3c08dcff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/3eb7a01d-5703-4937-8535-aa85fdd60cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/d2ffcc94-1e52-4292-a36e-c9bd8c69a477_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2026-01-22/image/44ee6110-e1f5-4bc8-9bca-6557d312bd32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/25-6k,', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e0cc06b-ea1c-498f-ba3c-bceb8359757f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097ca7f5-3677-5894-b392-33f28a02baf9 with identifier: 118775449
2026-01-28 19:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097ca7f5-3677-5894-b392-33f28a02baf9 with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097ca7f5-3677-5894-b392-33f28a02baf9 with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 097ca7f5-3677-5894-b392-33f28a02baf9, identifier: 118775449
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119099408, 'registration': 'VRZ3116', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI Sport 5dr S Tronic', 'mileage': 38025, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-02-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119099408, 'registration': 'VRZ3116', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI Sport 5dr S Tronic', 'mileage': 38025, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-02-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b87a45-94a7-57bc-baa5-212969853669 with identifier: 119099408
2026-01-28 19:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b87a45-94a7-57bc-baa5-212969853669 with scrape type 1
2026-01-28 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 01b87a45-94a7-57bc-baa5-212969853669
2026-01-28 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 01b87a45-94a7-57bc-baa5-212969853669
2026-01-28 19:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 01b87a45-94a7-57bc-baa5-212969853669, identifier: 119099408
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118556340, 'registration': 'LD25TNK', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10540, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2025-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD25TNK/2026-01-21/image/6664d1b2-926d-47b9-b4f0-f4db4e4a8788_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/51922126-6d95-4287-be85-0e10f1656a60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/eecb925c-147b-4282-8e56-ec9c13d8f271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/8f79e93f-cff2-4a2d-9349-b0a002a81bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/9732eb63-ea21-42ca-a629-8283aa411d39_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/26211935-43d3-48ad-b5e3-99dbffad929d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/4dafc9cb-a18a-458b-ae61-b00b64a2b082_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/bedf3eb5-84d6-44e3-aca8-043fbeb2b51b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/207d6f03-4783-4f9d-9180-8375cda2990d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/0cae9e21-109a-4ac7-80df-bfa8d0f8d0dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/434594a5-bf30-48d6-8531-0eabef80ec8e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118556340, 'registration': 'LD25TNK', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10540, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2025-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD25TNK/2026-01-21/image/6664d1b2-926d-47b9-b4f0-f4db4e4a8788_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/51922126-6d95-4287-be85-0e10f1656a60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/eecb925c-147b-4282-8e56-ec9c13d8f271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/8f79e93f-cff2-4a2d-9349-b0a002a81bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/9732eb63-ea21-42ca-a629-8283aa411d39_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/26211935-43d3-48ad-b5e3-99dbffad929d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/4dafc9cb-a18a-458b-ae61-b00b64a2b082_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/bedf3eb5-84d6-44e3-aca8-043fbeb2b51b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/207d6f03-4783-4f9d-9180-8375cda2990d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD25TNK/2026-01-21/image/0cae9e21-109a-4ac7-80df-bfa8d0f8d0dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/434594a5-bf30-48d6-8531-0eabef80ec8e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with identifier: 118556340
2026-01-28 19:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4, identifier: 118556340
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119016033, 'registration': 'WP72GXK', 'account': 'MOT070', 'make': 'FORD', 'model': 'S-MAX ESTATE', 'derivative': '2.5 FHEV 190 Titanium 5dr CVT', 'mileage': 50147, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-22', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WP72GXK/2026-01-27/image/0644d018-03b9-4207-8088-98f7976bcd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/296be53c-21ab-4042-8ec1-f6e4c43d145b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/fce0f066-1dcb-483d-ae80-1cc90c2bf432_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/04948487-007e-4072-ae87-455278a8eb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/db11a0c8-a79d-43f8-bf77-e7096a9dfa64_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/4401031c-daed-4304-8a45-243a56219a4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/7e4d98cc-f070-4b28-bd65-d77d5e6c95d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/37311ab3-b811-4971-82ff-58fec7955d70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/70fe0d00-5656-40c6-bb8a-33f527aa4a4d_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 19k, 06/24- 29k, 01/25- 37k', 'remarks': 'vosa @ 48k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9b01ba4-2ad1-4654-8942-ae6fcdedfc69.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119016033, 'registration': 'WP72GXK', 'account': 'MOT070', 'make': 'FORD', 'model': 'S-MAX ESTATE', 'derivative': '2.5 FHEV 190 Titanium 5dr CVT', 'mileage': 50147, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-22', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WP72GXK/2026-01-27/image/0644d018-03b9-4207-8088-98f7976bcd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/296be53c-21ab-4042-8ec1-f6e4c43d145b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/fce0f066-1dcb-483d-ae80-1cc90c2bf432_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/04948487-007e-4072-ae87-455278a8eb40_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/db11a0c8-a79d-43f8-bf77-e7096a9dfa64_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/4401031c-daed-4304-8a45-243a56219a4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/7e4d98cc-f070-4b28-bd65-d77d5e6c95d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/37311ab3-b811-4971-82ff-58fec7955d70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72GXK/2026-01-27/image/70fe0d00-5656-40c6-bb8a-33f527aa4a4d_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 19k, 06/24- 29k, 01/25- 37k', 'remarks': 'vosa @ 48k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9b01ba4-2ad1-4654-8942-ae6fcdedfc69.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce3eb865-b57f-59f1-945b-90ab96c7942e with identifier: 119016033
2026-01-28 19:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce3eb865-b57f-59f1-945b-90ab96c7942e with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce3eb865-b57f-59f1-945b-90ab96c7942e with scrape type 2
2026-01-28 19:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ce3eb865-b57f-59f1-945b-90ab96c7942e, identifier: 119016033
2026-01-28 19:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 097ca7f5-3677-5894-b392-33f28a02baf9 with identifier: 118775449
2026-01-28 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 097ca7f5-3677-5894-b392-33f28a02baf9 with identifier: 118775449
2026-01-28 19:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 097ca7f5-3677-5894-b392-33f28a02baf9 with identifier: 118775449 to the API
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27097ca7f5-3677-5894-b392-33f28a02baf9%27 HTTP/1.1" 200 None
2026-01-28 19:04:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 097ca7f5-3677-5894-b392-33f28a02baf9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118775449?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '097ca7f5-3677-5894-b392-33f28a02baf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EO24NUP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118775449',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': '2008 ESTATE',
'odometer': 10263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-03',
'seller_name': 'Motability Operations',
'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT 5dr EAT8',
'transmission': 'automatic',
'trim': '1.2 PureTech 130 GT 5dr EAT8',
'vin': None,
'year': 2024}
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118775449%27 HTTP/1.1" 200 None
2026-01-28 19:04:59 [astonbarclay.gb] INFO: Saving data for 118775449: {'auction_closing_time': 1769774400.0, 'created_time': 1768936290.439035, 'last_price_update_time': 1769627099.924046}
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118775449') HTTP/1.1" 204 0
2026-01-28 19:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 01b87a45-94a7-57bc-baa5-212969853669 with identifier: 119099408
2026-01-28 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 01b87a45-94a7-57bc-baa5-212969853669 with identifier: 119099408
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 01b87a45-94a7-57bc-baa5-212969853669 with identifier: 119099408 to the API
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2701b87a45-94a7-57bc-baa5-212969853669%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 01b87a45-94a7-57bc-baa5-212969853669: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119099408?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '01b87a45-94a7-57bc-baa5-212969853669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'VRZ3116',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119099408',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'AUDI',
'model': 'Q2 ESTATE',
'odometer': 38025,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-23',
'seller_name': 'Motability Operations',
'title': 'AUDI Q2 ESTATE 35 TFSI Sport 5dr S Tronic',
'transmission': 'automatic',
'trim': '35 TFSI Sport 5dr S Tronic',
'vin': None,
'year': 2024}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099408%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [astonbarclay.gb] INFO: Saving data for 119099408: {'created_time': 1769627100.246638, 'last_price_update_time': 1769627100.246648, 'auction_closing_time': 1770114600.0}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119099408') HTTP/1.1" 204 0
2026-01-28 19:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with identifier: 118556340
2026-01-28 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with identifier: 118556340
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4 with identifier: 118556340 to the API
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118556340?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': 'd0b25d4b-1ce9-51ce-a625-2ce62cc4c0b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LD25TNK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118556340',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'PEUGEOT',
'model': '2008 ESTATE',
'odometer': 10540,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-21',
'seller_name': 'Motability Operations',
'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT 5dr EAT8',
'transmission': 'automatic',
'trim': '1.2 PureTech 130 GT 5dr EAT8',
'vin': None,
'year': 2025}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118556340%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [astonbarclay.gb] INFO: Saving data for 118556340: {'auction_closing_time': 1769774400.0, 'created_time': 1768590611.572948, 'last_price_update_time': 1769627100.520084}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118556340') HTTP/1.1" 204 0
2026-01-28 19:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ce3eb865-b57f-59f1-945b-90ab96c7942e with identifier: 119016033
2026-01-28 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ce3eb865-b57f-59f1-945b-90ab96c7942e with identifier: 119016033
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ce3eb865-b57f-59f1-945b-90ab96c7942e with identifier: 119016033 to the API
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ce3eb865-b57f-59f1-945b-90ab96c7942e%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ce3eb865-b57f-59f1-945b-90ab96c7942e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:04:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119016033?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': 'ce3eb865-b57f-59f1-945b-90ab96c7942e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WP72GXK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119016033',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'FORD',
'model': 'S-MAX ESTATE',
'odometer': 50147,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seller_name': 'Motability Operations',
'title': 'FORD S-MAX ESTATE 2.5 FHEV 190 Titanium 5dr CVT',
'transmission': 'automatic',
'trim': '2.5 FHEV 190 Titanium 5dr CVT',
'vin': None,
'year': 2022}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119016033%27 HTTP/1.1" 200 None
2026-01-28 19:05:00 [astonbarclay.gb] INFO: Saving data for 119016033: {'auction_closing_time': 1770114600.0, 'created_time': 1769504578.064478, 'last_price_update_time': 1769627100.833537}
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119016033') HTTP/1.1" 204 0
2026-01-28 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183724850>
2026-01-28 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119052520?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119038790?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119091796?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118602418?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119052520, 'registration': 'YC19YKU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SDV6 HSE Luxury 5dr Auto', 'mileage': 111952, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 202, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8566511a-1c33-44f7-b309-0703c2feeca7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119052520, 'registration': 'YC19YKU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SDV6 HSE Luxury 5dr Auto', 'mileage': 111952, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 202, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8566511a-1c33-44f7-b309-0703c2feeca7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218191ca-62f3-5352-99fd-90c56c085a7e with identifier: 119052520
2026-01-28 19:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218191ca-62f3-5352-99fd-90c56c085a7e with scrape type 1
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 218191ca-62f3-5352-99fd-90c56c085a7e
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 218191ca-62f3-5352-99fd-90c56c085a7e
2026-01-28 19:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 218191ca-62f3-5352-99fd-90c56c085a7e, identifier: 119052520
2026-01-28 19:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 218191ca-62f3-5352-99fd-90c56c085a7e with identifier: 119052520
2026-01-28 19:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 218191ca-62f3-5352-99fd-90c56c085a7e with identifier: 119052520
2026-01-28 19:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180168 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180168
2026-01-28 19:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 218191ca-62f3-5352-99fd-90c56c085a7e spider: astonbarclay.gb
2026-01-28 19:05:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 218191ca-62f3-5352-99fd-90c56c085a7e due to rule: high_mileage_for_country.json, error: 180168 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180168
{'auction_title': '',
'c_o_2_emission_value': 202,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Diesel',
'id': '218191ca-62f3-5352-99fd-90c56c085a7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YC19YKU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119052520',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'LAND ROVER',
'model': 'DISCOVERY DIESEL SW',
'odometer': 111952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-27',
'seller_name': 'UKCGR - Select',
'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 SDV6 HSE Luxury 5dr Auto',
'transmission': 'automatic',
'trim': '3.0 SDV6 HSE Luxury 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052520%27 HTTP/1.1" 200 None
2026-01-28 19:05:01 [astonbarclay.gb] INFO: Saving data for 119052520: {'created_time': 1769627101.9157, 'last_price_update_time': 1769627101.915711, 'auction_closing_time': 1770053400.0}
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119052520') HTTP/1.1" 204 0
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118879129?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119097501?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119038790, 'registration': 'YH68UTG', 'account': 'WBA003', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO 150 GT 5dr DSG', 'mileage': 108542, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-11-05', 'fuel': 'Petrol', 'motExpiry': '2026-12-18', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1d18840c-16e0-4daf-9d0e-0f0d33dd66c3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119038790, 'registration': 'YH68UTG', 'account': 'WBA003', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO 150 GT 5dr DSG', 'mileage': 108542, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-11-05', 'fuel': 'Petrol', 'motExpiry': '2026-12-18', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1d18840c-16e0-4daf-9d0e-0f0d33dd66c3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 with identifier: 119038790
2026-01-28 19:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 with scrape type 1
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271
2026-01-28 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271
2026-01-28 19:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271, identifier: 119038790
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119063729, 'registration': 'YJ73WLG', 'account': 'MOT070', 'make': 'MAZDA', 'model': 'CX-30 HATCHBACK', 'derivative': '2.0 e-Skyactiv G MHEV Centre-Line 5dr Auto', 'mileage': 12536, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-10-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/24- 5k, 10/25- 11k', 'remarks': 'SD CARD IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c10d260f-c15d-46e6-95db-dc8d28856bcf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119063729, 'registration': 'YJ73WLG', 'account': 'MOT070', 'make': 'MAZDA', 'model': 'CX-30 HATCHBACK', 'derivative': '2.0 e-Skyactiv G MHEV Centre-Line 5dr Auto', 'mileage': 12536, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-10-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/24- 5k, 10/25- 11k', 'remarks': 'SD CARD IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c10d260f-c15d-46e6-95db-dc8d28856bcf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with identifier: 119063729
2026-01-28 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with scrape type 1
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252Fe4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119091796, 'registration': 'LL18KMF', 'account': 'CAR001', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK SPECIAL EDITIONS', 'derivative': '1.2 Dualjet Adventure 5dr', 'mileage': 26367, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 05/19 1K - 07/20 3K - 08/27 5K - 10/22 8K - 11/23 14K - 12/24 20K', 'remarks': 'VOSA STATES, 7K, 13K, 18K, 24K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc38daa8-fb9a-4d25-9f58-e91f0bc85970.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119091796, 'registration': 'LL18KMF', 'account': 'CAR001', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK SPECIAL EDITIONS', 'derivative': '1.2 Dualjet Adventure 5dr', 'mileage': 26367, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 05/19 1K - 07/20 3K - 08/27 5K - 10/22 8K - 11/23 14K - 12/24 20K', 'remarks': 'VOSA STATES, 7K, 13K, 18K, 24K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc38daa8-fb9a-4d25-9f58-e91f0bc85970.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93a4f427-ccff-567c-988a-83392ac6eea4 with identifier: 119091796
2026-01-28 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93a4f427-ccff-567c-988a-83392ac6eea4 with scrape type 1
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 93a4f427-ccff-567c-988a-83392ac6eea4
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 93a4f427-ccff-567c-988a-83392ac6eea4
2026-01-28 19:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 93a4f427-ccff-567c-988a-83392ac6eea4, identifier: 119091796
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190094ed0>
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118602418, 'registration': 'EY66PVU', 'account': 'PAU096', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium 5dr Powershift', 'mileage': 120820, 'mileageWarranty': True, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-12', 'fuel': 'Diesel', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EY66PVU/2026-01-15/image/abcdf601-af8d-40d1-a3cd-0c462e5ae26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/520fda17-e037-4218-a93f-f21f2fce0a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/182e4b20-a5d9-43ff-ada8-fcdc4d707a59_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/33b238fc-c734-404d-a380-6de9b021bf06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/bd10443b-d6c4-4552-9451-f6f5f229e76c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/7a57c64b-d001-4800-ab4b-a351a375296b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/2e344f4a-b72b-4b05-89ef-0ae40eba61a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/2bcf01d9-f0a0-4098-b28a-de2e028e6020_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/19- 17K, 09/20 - 26K, 09/21 - 43K, 07/22 - 57K', 'remarks': 'VOSA STATES 60K, 81K, 102K, 116K SPARE KEY WITH PAPERWORK', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00df6ca9-7c38-49ab-a97f-08ecff7ce246.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118602418, 'registration': 'EY66PVU', 'account': 'PAU096', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium 5dr Powershift', 'mileage': 120820, 'mileageWarranty': True, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-12', 'fuel': 'Diesel', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EY66PVU/2026-01-15/image/abcdf601-af8d-40d1-a3cd-0c462e5ae26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/520fda17-e037-4218-a93f-f21f2fce0a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/182e4b20-a5d9-43ff-ada8-fcdc4d707a59_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/33b238fc-c734-404d-a380-6de9b021bf06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/bd10443b-d6c4-4552-9451-f6f5f229e76c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/7a57c64b-d001-4800-ab4b-a351a375296b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/2e344f4a-b72b-4b05-89ef-0ae40eba61a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY66PVU/2026-01-15/image/2bcf01d9-f0a0-4098-b28a-de2e028e6020_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/19- 17K, 09/20 - 26K, 09/21 - 43K, 07/22 - 57K', 'remarks': 'VOSA STATES 60K, 81K, 102K, 116K SPARE KEY WITH PAPERWORK', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00df6ca9-7c38-49ab-a97f-08ecff7ce246.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 with identifier: 118602418
2026-01-28 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 with scrape type 2
2026-01-28 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 with scrape type 2
2026-01-28 19:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7, identifier: 118602418
2026-01-28 19:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 with identifier: 119038790
2026-01-28 19:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 with identifier: 119038790
2026-01-28 19:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174680 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174680
2026-01-28 19:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 spider: astonbarclay.gb
2026-01-28 19:05:02 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271 due to rule: high_mileage_for_country.json, error: 174680 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174680
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': 'c7d77bb6-a3d1-59a1-92ae-5ffa2cb25271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YH68UTG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119038790',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'VOLKSWAGEN',
'model': 'GOLF HATCHBACK',
'odometer': 108542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-05',
'seller_name': 'UKCGR - Select',
'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI EVO 150 GT 5dr DSG',
'transmission': 'automatic',
'trim': '1.5 TSI EVO 150 GT 5dr DSG',
'vin': None,
'year': 2018}
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119038790%27 HTTP/1.1" 200 None
2026-01-28 19:05:02 [astonbarclay.gb] INFO: Saving data for 119038790: {'created_time': 1769627102.880261, 'last_price_update_time': 1769627102.880272, 'auction_closing_time': 1770053400.0}
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119038790') HTTP/1.1" 204 0
2026-01-28 19:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 93a4f427-ccff-567c-988a-83392ac6eea4 with identifier: 119091796
2026-01-28 19:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 93a4f427-ccff-567c-988a-83392ac6eea4 with identifier: 119091796
2026-01-28 19:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 93a4f427-ccff-567c-988a-83392ac6eea4 with identifier: 119091796 to the API
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2793a4f427-ccff-567c-988a-83392ac6eea4%27 HTTP/1.1" 200 None
2026-01-28 19:05:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 93a4f427-ccff-567c-988a-83392ac6eea4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119091796?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': '93a4f427-ccff-567c-988a-83392ac6eea4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LL18KMF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119091796',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'SUZUKI',
'model': 'IGNIS HATCHBACK SPECIAL EDITIONS',
'odometer': 26367,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-21',
'seller_name': 'CarGiant',
'title': 'SUZUKI IGNIS HATCHBACK SPECIAL EDITIONS 1.2 Dualjet Adventure 5dr',
'transmission': 'manual',
'trim': '1.2 Dualjet Adventure 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119091796%27 HTTP/1.1" 200 None
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Saving data for 119091796: {'created_time': 1769627103.182114, 'last_price_update_time': 1769627103.182126, 'auction_closing_time': 1770053400.0}
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119091796') HTTP/1.1" 204 0
2026-01-28 19:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 with identifier: 118602418
2026-01-28 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 with identifier: 118602418
2026-01-28 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194440 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
194440
2026-01-28 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 spider: astonbarclay.gb
2026-01-28 19:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 06a9ea52-35d9-53f3-84f5-1dcdbc8983f7 due to rule: high_mileage_for_country.json, error: 194440 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
194440
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Diesel',
'id': '06a9ea52-35d9-53f3-84f5-1dcdbc8983f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EY66PVU',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118602418',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'S-MAX DIESEL ESTATE',
'odometer': 120820,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-12',
'seller_name': 'Local Dealer Group',
'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 150 Titanium 5dr Powershift',
'transmission': 'automatic',
'trim': '2.0 TDCi 150 Titanium 5dr Powershift',
'vin': None,
'year': 2016}
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118602418%27 HTTP/1.1" 200 None
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Saving data for 118602418: {'auction_closing_time': 1769774400.0, 'created_time': 1768417444.287345, 'last_price_update_time': 1769627103.402144}
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118602418') HTTP/1.1" 204 0
2026-01-28 19:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252Fc5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190d203d0>
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252Fb7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190272590>
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 118879129, 'registration': 'DK18UWF', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 116752, 'mileageWarranty': False, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK18UWF/2026-01-21/image/c44a4028-35aa-4c04-9db2-59f465c93dd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/eb08aec9-d980-428c-946d-642924847462_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/e846d02d-42b5-446e-90ff-2bdb83618cb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/dcca712a-38cc-4630-8c14-f53087767324_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/7b4f51c0-40b2-4bc3-a435-9c3b075984f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/c5d6c486-be87-4e43-aeb6-be1a207338c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/5aa222ea-2561-4010-bfb5-4d5b2b4fdf36_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 70K- 85K - 91K - 104K - 116K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c6d6ebc-acd7-4217-b707-d78da82e1aa1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 118879129, 'registration': 'DK18UWF', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 116752, 'mileageWarranty': False, 'type': 'car', 'saleId': 18592, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-01-30T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK18UWF/2026-01-21/image/c44a4028-35aa-4c04-9db2-59f465c93dd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/eb08aec9-d980-428c-946d-642924847462_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/e846d02d-42b5-446e-90ff-2bdb83618cb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/dcca712a-38cc-4630-8c14-f53087767324_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/7b4f51c0-40b2-4bc3-a435-9c3b075984f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/c5d6c486-be87-4e43-aeb6-be1a207338c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK18UWF/2026-01-21/image/5aa222ea-2561-4010-bfb5-4d5b2b4fdf36_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 70K- 85K - 91K - 104K - 116K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c6d6ebc-acd7-4217-b707-d78da82e1aa1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 with identifier: 118879129
2026-01-28 19:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 with scrape type 2
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 with scrape type 2
2026-01-28 19:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723, identifier: 118879129
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119097501, 'registration': 'LM22ULS', 'account': 'MOT070', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 48V GT-Line 5dr', 'mileage': 25985, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-05-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 21k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119097501, 'registration': 'LM22ULS', 'account': 'MOT070', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 48V GT-Line 5dr', 'mileage': 25985, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-05-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa - 21k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a934ca2-be87-5f37-bbc6-1cef0f12d841 with identifier: 119097501
2026-01-28 19:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a934ca2-be87-5f37-bbc6-1cef0f12d841 with scrape type 1
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8a934ca2-be87-5f37-bbc6-1cef0f12d841
2026-01-28 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8a934ca2-be87-5f37-bbc6-1cef0f12d841
2026-01-28 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8a934ca2-be87-5f37-bbc6-1cef0f12d841, identifier: 119097501
2026-01-28 19:05:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119088482, 'registration': 'WK73MLL', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L Executive 5dr DSG [7 Seat]', 'mileage': 24897, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/411ac344-ae97-4c51-9340-9d3422da5ce4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119088482, 'registration': 'WK73MLL', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L Executive 5dr DSG [7 Seat]', 'mileage': 24897, 'mileageWarranty': True, 'type': 'car', 'saleId': 18352, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-02-03T10:30Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/411ac344-ae97-4c51-9340-9d3422da5ce4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb176dd-4953-5bcb-962d-a6ec7e68730d with identifier: 119088482
2026-01-28 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb176dd-4953-5bcb-962d-a6ec7e68730d with scrape type 1
2026-01-28 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fe5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 with identifier: 118879129
2026-01-28 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 with identifier: 118879129
2026-01-28 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187893 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187893
2026-01-28 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 spider: astonbarclay.gb
2026-01-28 19:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 342e40b2-58ac-5bc0-a1b1-3f8fae3c6723 due to rule: high_mileage_for_country.json, error: 187893 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187893
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T12:00:00Z',
'fuel_type': 'Petrol',
'id': '342e40b2-58ac-5bc0-a1b1-3f8fae3c6723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DK18UWF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118879129',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 116752,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-09',
'seller_name': 'Manamanx Ltd',
'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Titanium 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Titanium 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118879129%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [astonbarclay.gb] INFO: Saving data for 118879129: {'auction_closing_time': 1769774400.0, 'created_time': 1769022111.056229, 'last_price_update_time': 1769627104.385352}
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118879129') HTTP/1.1" 204 0
2026-01-28 19:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8a934ca2-be87-5f37-bbc6-1cef0f12d841 with identifier: 119097501
2026-01-28 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8a934ca2-be87-5f37-bbc6-1cef0f12d841 with identifier: 119097501
2026-01-28 19:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8a934ca2-be87-5f37-bbc6-1cef0f12d841 with identifier: 119097501 to the API
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278a934ca2-be87-5f37-bbc6-1cef0f12d841%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8a934ca2-be87-5f37-bbc6-1cef0f12d841: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119097501?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '8a934ca2-be87-5f37-bbc6-1cef0f12d841',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LM22ULS',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119097501',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'KIA',
'model': 'STONIC ESTATE',
'odometer': 25985,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-13',
'seller_name': 'Motability Operations',
'title': 'KIA STONIC ESTATE 1.0T GDi 48V GT-Line 5dr',
'transmission': 'manual',
'trim': '1.0T GDi 48V GT-Line 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119097501%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [astonbarclay.gb] INFO: Saving data for 119097501: {'created_time': 1769627104.721509, 'last_price_update_time': 1769627104.721523, 'auction_closing_time': 1770114600.0}
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119097501') HTTP/1.1" 204 0
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119092918?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118472330?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903b7550>
2026-01-28 19:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fc8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31917b1690>
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901aef10>
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252F77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119092918, 'registration': 'SL20EKR', 'account': 'CAR001', 'make': 'TOYOTA', 'model': 'COROLLA HATCHBACK', 'derivative': '1.8 VVT-i Hybrid Excel 5dr CVT', 'mileage': 75597, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-07-08', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2027-01-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e290f99-5f12-4884-9c09-a12ac3aa147c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119092918, 'registration': 'SL20EKR', 'account': 'CAR001', 'make': 'TOYOTA', 'model': 'COROLLA HATCHBACK', 'derivative': '1.8 VVT-i Hybrid Excel 5dr CVT', 'mileage': 75597, 'mileageWarranty': False, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-07-08', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2027-01-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e290f99-5f12-4884-9c09-a12ac3aa147c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bf43c6-97b6-5206-8713-27a273be8cac with identifier: 119092918
2026-01-28 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bf43c6-97b6-5206-8713-27a273be8cac with scrape type 1
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 73bf43c6-97b6-5206-8713-27a273be8cac
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 73bf43c6-97b6-5206-8713-27a273be8cac
2026-01-28 19:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 73bf43c6-97b6-5206-8713-27a273be8cac, identifier: 119092918
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119099618, 'registration': 'KP68ZPS', 'account': 'AST061', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C220d AMG Line Premium 2dr 9G-Tronic', 'mileage': 86346, 'mileageWarranty': True, 'type': 'car', 'saleId': 18553, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-05-26', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 9/19 10k, 9/21 33k, 9/22 47k, 9/23 59k, 10/24 72k, 10/25 84k', 'remarks': 'VOSA STATES 47K, 53K, 64K, 79K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/129e685a-e22c-453a-9704-5b88eea119b7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119099618, 'registration': 'KP68ZPS', 'account': 'AST061', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C220d AMG Line Premium 2dr 9G-Tronic', 'mileage': 86346, 'mileageWarranty': True, 'type': 'car', 'saleId': 18553, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-05-26', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 9/19 10k, 9/21 33k, 9/22 47k, 9/23 59k, 10/24 72k, 10/25 84k', 'remarks': 'VOSA STATES 47K, 53K, 64K, 79K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/129e685a-e22c-453a-9704-5b88eea119b7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0099a3a-c4a4-58ec-b244-321e4777ccec with identifier: 119099618
2026-01-28 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0099a3a-c4a4-58ec-b244-321e4777ccec with scrape type 1
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F282e599d-715f-479e-9db3-437da7109031_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118964467, 'registration': 'LX67OHF', 'account': 'CAR404', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67421, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Intermittent EML/Limp mode', 'virtual': False, 'seller': 'Zero pricing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/faad44d3-bd7b-4cfb-afbd-9b579bf81393.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118964467, 'registration': 'LX67OHF', 'account': 'CAR404', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67421, 'mileageWarranty': True, 'type': 'car', 'saleId': 18591, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Intermittent EML/Limp mode', 'virtual': False, 'seller': 'Zero pricing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/faad44d3-bd7b-4cfb-afbd-9b579bf81393.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with identifier: 118964467
2026-01-28 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with scrape type 1
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118472330, 'registration': 'EF25VYM', 'account': 'STE131', 'make': 'CITROEN', 'model': 'E-C3 ELECTRIC HATCHBACK', 'derivative': '83kW Max 44kWh 5dr Auto', 'mileage': 3110, 'mileageWarranty': True, 'type': 'car', 'saleId': 18553, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF25VYM/2026-01-09/image/a9927e39-6a17-4ad6-a055-03da0e887f0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/d487bb07-843e-4798-8d31-cc6125cd8077_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/329fe7d8-43ea-4608-894e-1cfe253f2d77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/97c3535e-982e-427b-b6ff-73a8ab6159a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/4543f95f-efd4-4655-bc37-2ba389c1560e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/a3efc2dc-89b4-45ad-8dbf-d365c7905d64_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/59820422-9ba9-4184-92b0-a71972d80928_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/72051eb7-bc4e-469c-98a3-ec22ca6f0be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/0d24a27c-e4c6-4690-be6f-6a2221cf82b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/bb52b150-e9d4-4dda-90c1-9ecf4bfb38c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/008d88a8-e3f9-4280-8835-b071141619a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/65b6414d-1a97-4d9b-bd6e-cc8b2cf6df9b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book NO STAMPS IN BOOK', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d5ea499-c172-48b4-8b9b-65d06d601b91.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118472330, 'registration': 'EF25VYM', 'account': 'STE131', 'make': 'CITROEN', 'model': 'E-C3 ELECTRIC HATCHBACK', 'derivative': '83kW Max 44kWh 5dr Auto', 'mileage': 3110, 'mileageWarranty': True, 'type': 'car', 'saleId': 18553, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 473}, 'saleStart': '2026-02-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF25VYM/2026-01-09/image/a9927e39-6a17-4ad6-a055-03da0e887f0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/d487bb07-843e-4798-8d31-cc6125cd8077_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/329fe7d8-43ea-4608-894e-1cfe253f2d77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/97c3535e-982e-427b-b6ff-73a8ab6159a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/4543f95f-efd4-4655-bc37-2ba389c1560e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/a3efc2dc-89b4-45ad-8dbf-d365c7905d64_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/59820422-9ba9-4184-92b0-a71972d80928_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/72051eb7-bc4e-469c-98a3-ec22ca6f0be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/0d24a27c-e4c6-4690-be6f-6a2221cf82b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/bb52b150-e9d4-4dda-90c1-9ecf4bfb38c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/008d88a8-e3f9-4280-8835-b071141619a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF25VYM/2026-01-09/image/65b6414d-1a97-4d9b-bd6e-cc8b2cf6df9b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book NO STAMPS IN BOOK', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d5ea499-c172-48b4-8b9b-65d06d601b91.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261d8a15-79ec-5efe-bc79-e850966f9197 with identifier: 118472330
2026-01-28 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261d8a15-79ec-5efe-bc79-e850966f9197 with scrape type 2
2026-01-28 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261d8a15-79ec-5efe-bc79-e850966f9197 with scrape type 2
2026-01-28 19:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 261d8a15-79ec-5efe-bc79-e850966f9197, identifier: 118472330
2026-01-28 19:05:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119036683, 'registration': 'YG20TVN', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 95 ST-Line Edition 5dr', 'mileage': 30188, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 374, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-08-07', 'fuel': 'Petrol', 'motExpiry': '2026-06-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**468** VOSA STATES 19K, 22K, 25K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baafd04c-bded-4942-910e-8efab9be75d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119036683, 'registration': 'YG20TVN', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 95 ST-Line Edition 5dr', 'mileage': 30188, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 374, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-08-07', 'fuel': 'Petrol', 'motExpiry': '2026-06-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**468** VOSA STATES 19K, 22K, 25K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baafd04c-bded-4942-910e-8efab9be75d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7420bbfb-ade6-5f8b-a529-0b3c62855060 with identifier: 119036683
2026-01-28 19:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7420bbfb-ade6-5f8b-a529-0b3c62855060 with scrape type 1
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:06 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 44 pages/min), scraped 127 items (at 38 items/min)
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 73bf43c6-97b6-5206-8713-27a273be8cac with identifier: 119092918
2026-01-28 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 73bf43c6-97b6-5206-8713-27a273be8cac with identifier: 119092918
2026-01-28 19:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 73bf43c6-97b6-5206-8713-27a273be8cac with identifier: 119092918 to the API
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2773bf43c6-97b6-5206-8713-27a273be8cac%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 73bf43c6-97b6-5206-8713-27a273be8cac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/119092918?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': '73bf43c6-97b6-5206-8713-27a273be8cac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'SL20EKR',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119092918',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'TOYOTA',
'model': 'COROLLA HATCHBACK',
'odometer': 75597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seller_name': 'CarGiant',
'title': 'TOYOTA COROLLA HATCHBACK 1.8 VVT-i Hybrid Excel 5dr CVT',
'transmission': 'automatic',
'trim': '1.8 VVT-i Hybrid Excel 5dr CVT',
'vin': None,
'year': 2020}
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119092918%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [astonbarclay.gb] INFO: Saving data for 119092918: {'created_time': 1769627106.337598, 'last_price_update_time': 1769627106.337608, 'auction_closing_time': 1770053400.0}
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119092918') HTTP/1.1" 204 0
2026-01-28 19:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 261d8a15-79ec-5efe-bc79-e850966f9197 with identifier: 118472330
2026-01-28 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 261d8a15-79ec-5efe-bc79-e850966f9197 with identifier: 118472330
2026-01-28 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'stellantis financial services uk', 'price_includes_vat': False, 'title': 'citroen e-c3 electric hatchback 83kw max 44kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'citroen', 'model': 'e-c3 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3110, 'odometer_reading_unit': 'mi', 'registration_date': '2025-06-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472330', 'expiration_date': '2026-02-02t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '83kw max 44kwh 5dr auto', 'license_plate': 'ef25vym', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '261d8a15-79ec-5efe-bc79-e850966f9197', 'current_year_diff': 1, 'age_in_months': 7, 'make_model': 'citroen e-c3 electric hatchback', 'sanitized_make': 'citroen', 'odometer_in_km': 5005} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 7,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-02t10:00:00z',
'fuel_type': 'electric',
'id': '261d8a15-79ec-5efe-bc79-e850966f9197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ef25vym',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472330',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'citroen',
'make_model': 'citroen e-c3 electric hatchback',
'model': 'e-c3 electric hatchback',
'odometer': 3110,
'odometer_in_km': 5005,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-18',
'sanitized_make': 'citroen',
'seller_name': 'stellantis financial services uk',
'title': 'citroen e-c3 electric hatchback 83kw max 44kwh 5dr auto',
'transmission': 'automatic',
'trim': '83kw max 44kwh 5dr auto',
'vin': None,
'year': 2025}
2026-01-28 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 261d8a15-79ec-5efe-bc79-e850966f9197 spider: astonbarclay.gb
2026-01-28 19:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 261d8a15-79ec-5efe-bc79-e850966f9197 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'stellantis financial services uk', 'price_includes_vat': False, 'title': 'citroen e-c3 electric hatchback 83kw max 44kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'citroen', 'model': 'e-c3 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3110, 'odometer_reading_unit': 'mi', 'registration_date': '2025-06-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472330', 'expiration_date': '2026-02-02t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '83kw max 44kwh 5dr auto', 'license_plate': 'ef25vym', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '261d8a15-79ec-5efe-bc79-e850966f9197', 'current_year_diff': 1, 'age_in_months': 7, 'make_model': 'citroen e-c3 electric hatchback', 'sanitized_make': 'citroen', 'odometer_in_km': 5005} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 7,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-02-02t10:00:00z',
'fuel_type': 'electric',
'id': '261d8a15-79ec-5efe-bc79-e850966f9197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ef25vym',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472330',
'listing': 'auction',
'location': 'aston barclay chelmsford',
'make': 'citroen',
'make_model': 'citroen e-c3 electric hatchback',
'model': 'e-c3 electric hatchback',
'odometer': 3110,
'odometer_in_km': 5005,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-18',
'sanitized_make': 'citroen',
'seller_name': 'stellantis financial services uk',
'title': 'citroen e-c3 electric hatchback 83kw max 44kwh 5dr auto',
'transmission': 'automatic',
'trim': '83kw max 44kwh 5dr auto',
'vin': None,
'year': 2025}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-02-02T10:00:00Z',
'fuel_type': 'Electric',
'id': '261d8a15-79ec-5efe-bc79-e850966f9197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'EF25VYM',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118472330',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'CITROEN',
'model': 'E-C3 ELECTRIC HATCHBACK',
'odometer': 3110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-18',
'seller_name': 'Stellantis Financial Services UK',
'title': 'CITROEN E-C3 ELECTRIC HATCHBACK 83kW Max 44kWh 5dr Auto',
'transmission': 'automatic',
'trim': '83kW Max 44kWh 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118472330%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [astonbarclay.gb] INFO: Saving data for 118472330: {'auction_closing_time': 1770026400.0, 'created_time': 1768381298.871683, 'last_price_update_time': 1769627106.802768}
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118472330') HTTP/1.1" 204 0
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118261211?view=catalogue)
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fc89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118601076?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118748001?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118988916?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901b9610>
2026-01-28 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252Fe4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319041a850>
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252Fc5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fe5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904da150>
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fe5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Ffd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Ff5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31917ea3d0>
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028ae50>
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190159650>
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71WZV%252F2026-01-02%252Fimage%252Fde5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0a8ebd4-2d28-51f6-881c-3581f6281976
2026-01-28 19:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0a8ebd4-2d28-51f6-881c-3581f6281976, skipping ID generation
2026-01-28 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a8ebd4-2d28-51f6-881c-3581f6281976 with scrape type 1
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a0a8ebd4-2d28-51f6-881c-3581f6281976 from tracking dictionaries
2026-01-28 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0a8ebd4-2d28-51f6-881c-3581f6281976 sending to next pipeline
2026-01-28 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a0a8ebd4-2d28-51f6-881c-3581f6281976, identifier: 118261211
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916ad250>
2026-01-28 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118601076, 'registration': 'EX70HLE', 'account': 'WBA002', 'make': 'CITROEN', 'model': 'C5 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 130 Flair Plus 5dr EAT8', 'mileage': 62938, 'mileageWarranty': False, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 358, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX70HLE/2026-01-15/image/da8c7f03-2dab-44ca-8444-b78621de846a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/993c5859-db6e-428a-bd72-018956ca21c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/4d58f625-8227-4466-a9ee-d6808abf0148_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/f0dffa8b-e6c1-4edf-9ebe-1dd9c7a6fbdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/600c2aac-511c-47ab-8b00-d4d23861f310_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/9a732738-fafb-43f6-816f-81b90b490e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/3e0ac614-c07d-491f-8712-c875bc24af5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/c02cf494-2476-4b4c-bf6c-56cf21ea2a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/8cb22339-e86d-4051-8bb2-5f10455ffcf3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/21 - 7K, 03/23 - 30K, 11/23 - 39K, 10/24 - 53K, 10/25 - 64K MILEAGE DISCREPANCY @64K', 'remarks': '**583** VOSA STATES 38K, 51K, 60K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5c26d129-9d34-4e3c-948d-519074f4d50c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118601076, 'registration': 'EX70HLE', 'account': 'WBA002', 'make': 'CITROEN', 'model': 'C5 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 130 Flair Plus 5dr EAT8', 'mileage': 62938, 'mileageWarranty': False, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 358, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX70HLE/2026-01-15/image/da8c7f03-2dab-44ca-8444-b78621de846a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/993c5859-db6e-428a-bd72-018956ca21c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/4d58f625-8227-4466-a9ee-d6808abf0148_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/f0dffa8b-e6c1-4edf-9ebe-1dd9c7a6fbdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/600c2aac-511c-47ab-8b00-d4d23861f310_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/9a732738-fafb-43f6-816f-81b90b490e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/3e0ac614-c07d-491f-8712-c875bc24af5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/c02cf494-2476-4b4c-bf6c-56cf21ea2a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX70HLE/2026-01-15/image/8cb22339-e86d-4051-8bb2-5f10455ffcf3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/21 - 7K, 03/23 - 30K, 11/23 - 39K, 10/24 - 53K, 10/25 - 64K MILEAGE DISCREPANCY @64K', 'remarks': '**583** VOSA STATES 38K, 51K, 60K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5c26d129-9d34-4e3c-948d-519074f4d50c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab228e2-e461-51b6-9577-0e0618e4744d with identifier: 118601076
2026-01-28 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab228e2-e461-51b6-9577-0e0618e4744d with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab228e2-e461-51b6-9577-0e0618e4744d with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dab228e2-e461-51b6-9577-0e0618e4744d, identifier: 118601076
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118748001, 'registration': 'LR21YJP', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': 'E-208 ELECTRIC HATCHBACK', 'derivative': '100kW GT Premium 50kWh 5dr Auto', 'mileage': 10313, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 372, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Electric', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LR21YJP/2026-01-19/image/d4166ac8-a443-4c68-bf22-bb7833c42ffb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/bc2f6f11-1367-491d-b0a8-efd6d30ab36e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/ef3306ed-dfc7-461a-8dae-1212c9de5e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/65e5df6c-0f79-4eb0-8d21-aec1140df167_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/cbd8c6c9-aa75-46fd-8ba1-fd3e3f066e41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/89407b53-f542-4535-9320-64e741751d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/5f8932b0-9c06-47b8-8749-01c2f0976d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/21f0a1bd-e320-4060-8e69-53e516ff95bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/ba63c9d3-59c9-41fd-9ef7-f4a51749169e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 1K, 09/24- 2K,', 'remarks': '**634** VOSA STATES 2K, 3K, SPARE KEY OUTSTANDING RECALL CHARGING CABLE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/655d466e-88fc-414f-9fd9-3da21b274048.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118748001, 'registration': 'LR21YJP', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': 'E-208 ELECTRIC HATCHBACK', 'derivative': '100kW GT Premium 50kWh 5dr Auto', 'mileage': 10313, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 372, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Electric', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LR21YJP/2026-01-19/image/d4166ac8-a443-4c68-bf22-bb7833c42ffb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/bc2f6f11-1367-491d-b0a8-efd6d30ab36e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/ef3306ed-dfc7-461a-8dae-1212c9de5e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/65e5df6c-0f79-4eb0-8d21-aec1140df167_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/cbd8c6c9-aa75-46fd-8ba1-fd3e3f066e41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/89407b53-f542-4535-9320-64e741751d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/5f8932b0-9c06-47b8-8749-01c2f0976d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/21f0a1bd-e320-4060-8e69-53e516ff95bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR21YJP/2026-01-19/image/ba63c9d3-59c9-41fd-9ef7-f4a51749169e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 1K, 09/24- 2K,', 'remarks': '**634** VOSA STATES 2K, 3K, SPARE KEY OUTSTANDING RECALL CHARGING CABLE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/655d466e-88fc-414f-9fd9-3da21b274048.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ea3436-7d29-5d45-810e-c5b9af909d12 with identifier: 118748001
2026-01-28 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ea3436-7d29-5d45-810e-c5b9af909d12 with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ea3436-7d29-5d45-810e-c5b9af909d12 with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53ea3436-7d29-5d45-810e-c5b9af909d12, identifier: 118748001
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118988916, 'registration': 'WR69TXC', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '2.0 TSI GTI+ 5dr DSG', 'mileage': 60101, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 373, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR69TXC/2026-01-26/image/8fb0109b-429d-4462-a42d-f50be495b4bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/34b0de72-ce0b-4c0c-8181-24ee6ae53bfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/491f9f9d-a7e9-4f45-bf48-b04088b4c053_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/7e62fefe-440e-470d-8635-d2a556539b85_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/c48e427f-59b2-4c76-868b-0d8d2a7ab422_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/e00085ec-8bc9-4d3b-8bbb-696c71c174d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/5dff6f8f-c0e5-4fb2-8db7-6ab88812795f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/fe1fe131-a50f-46b5-b4a1-52432f03969c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/216d009f-61cd-4c06-8df6-58bd6d475bba_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 23K, 11/23 - NO MILEAGE, 07/24 - NO MILEAGE', 'remarks': '**607** VOSA STATES 22K, 31K, 43K, 58K,SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f80029b9-fd39-4879-8984-33d04e77460c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118988916, 'registration': 'WR69TXC', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '2.0 TSI GTI+ 5dr DSG', 'mileage': 60101, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 373, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR69TXC/2026-01-26/image/8fb0109b-429d-4462-a42d-f50be495b4bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/34b0de72-ce0b-4c0c-8181-24ee6ae53bfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/491f9f9d-a7e9-4f45-bf48-b04088b4c053_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/7e62fefe-440e-470d-8635-d2a556539b85_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/c48e427f-59b2-4c76-868b-0d8d2a7ab422_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/e00085ec-8bc9-4d3b-8bbb-696c71c174d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/5dff6f8f-c0e5-4fb2-8db7-6ab88812795f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/fe1fe131-a50f-46b5-b4a1-52432f03969c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR69TXC/2026-01-26/image/216d009f-61cd-4c06-8df6-58bd6d475bba_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 23K, 11/23 - NO MILEAGE, 07/24 - NO MILEAGE', 'remarks': '**607** VOSA STATES 22K, 31K, 43K, 58K,SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f80029b9-fd39-4879-8984-33d04e77460c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with identifier: 118988916
2026-01-28 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with scrape type 2
2026-01-28 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2a70f0d4-733a-5bfa-a85c-0384e9d9f627, identifier: 118988916
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fe3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fde221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a0a8ebd4-2d28-51f6-881c-3581f6281976 with identifier: 118261211
2026-01-28 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a0a8ebd4-2d28-51f6-881c-3581f6281976 with identifier: 118261211
2026-01-28 19:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a0a8ebd4-2d28-51f6-881c-3581f6281976 with identifier: 118261211 to the API
2026-01-28 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': 'a0a8ebd4-2d28-51f6-881c-3581f6281976',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'FG71WZV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118261211',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'BMW',
'model': 'X3 ESTATE',
'odometer': 58976,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32511,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/de5228a0-6a09-4f4d-ad4c-5c567edaac7a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32054,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/851800cc-a7b0-4d98-91c5-3829c74c4f19_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30601,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/77812d7f-5f05-4a67-a499-c7b142330816_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30810,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/9893a0f2-d162-4fb1-a453-9d5b1221bed0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43866,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/3aec635a-4153-4037-849b-65b40e9bc882_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58363,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/b7c5c22b-d401-49c0-a02b-88e53c9c74ad_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55543,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/493a7550-8ebf-477c-ae7f-abb99bf5b654_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a8ebd4-2d28-51f6-881c-3581f6281976/a0a8ebd4-2d28-51f6-881c-3581f6281976_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57378,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FG71WZV/2026-01-02/image/0343b39e-881d-482c-8e90-aa3a529a8c0a_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-01',
'seller_name': 'Zenith',
'title': 'BMW X3 ESTATE xDrive 30e M Sport 5dr Auto',
'transmission': 'automatic',
'trim': 'xDrive 30e M Sport 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118261211%27 HTTP/1.1" 200 None
2026-01-28 19:05:10 [astonbarclay.gb] INFO: Saving data for 118261211: {'created_time': 1769627110.569954, 'last_price_update_time': 1769627110.569964, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118261211') HTTP/1.1" 204 0
2026-01-28 19:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dab228e2-e461-51b6-9577-0e0618e4744d with identifier: 118601076
2026-01-28 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dab228e2-e461-51b6-9577-0e0618e4744d with identifier: 118601076
2026-01-28 19:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dab228e2-e461-51b6-9577-0e0618e4744d with identifier: 118601076 to the API
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27dab228e2-e461-51b6-9577-0e0618e4744d%27 HTTP/1.1" 200 None
2026-01-28 19:05:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id dab228e2-e461-51b6-9577-0e0618e4744d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118601076?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': 'dab228e2-e461-51b6-9577-0e0618e4744d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'EX70HLE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118601076',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'CITROEN',
'model': 'C5 AIRCROSS HATCHBACK',
'odometer': 62938,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seller_name': 'UKCGR - Premium',
'title': 'CITROEN C5 AIRCROSS HATCHBACK 1.2 PureTech 130 Flair Plus 5dr EAT8',
'transmission': 'automatic',
'trim': '1.2 PureTech 130 Flair Plus 5dr EAT8',
'vin': None,
'year': 2020}
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118601076%27 HTTP/1.1" 200 None
2026-01-28 19:05:10 [astonbarclay.gb] INFO: Saving data for 118601076: {'auction_closing_time': 1769766300.0, 'created_time': 1768417564.558369, 'last_price_update_time': 1769627110.877366}
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118601076') HTTP/1.1" 204 0
2026-01-28 19:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53ea3436-7d29-5d45-810e-c5b9af909d12 with identifier: 118748001
2026-01-28 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53ea3436-7d29-5d45-810e-c5b9af909d12 with identifier: 118748001
2026-01-28 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'ukcgr - premium', 'price_includes_vat': False, 'title': 'peugeot e-208 electric hatchback 100kw gt premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-208 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10313, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118748001', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '100kw gt premium 50kwh 5dr auto', 'license_plate': 'lr21yjp', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '53ea3436-7d29-5d45-810e-c5b9af909d12', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot e-208 electric hatchback', 'sanitized_make': 'peugeot', 'odometer_in_km': 16597} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 57,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '53ea3436-7d29-5d45-810e-c5b9af909d12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lr21yjp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118748001',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'peugeot',
'make_model': 'peugeot e-208 electric hatchback',
'model': 'e-208 electric hatchback',
'odometer': 10313,
'odometer_in_km': 16597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'sanitized_make': 'peugeot',
'seller_name': 'ukcgr - premium',
'title': 'peugeot e-208 electric hatchback 100kw gt premium 50kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw gt premium 50kwh 5dr auto',
'vin': None,
'year': 2021}
2026-01-28 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 53ea3436-7d29-5d45-810e-c5b9af909d12 spider: astonbarclay.gb
2026-01-28 19:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 53ea3436-7d29-5d45-810e-c5b9af909d12 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'ukcgr - premium', 'price_includes_vat': False, 'title': 'peugeot e-208 electric hatchback 100kw gt premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-208 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10313, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118748001', 'expiration_date': '2026-01-30t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '100kw gt premium 50kwh 5dr auto', 'license_plate': 'lr21yjp', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '53ea3436-7d29-5d45-810e-c5b9af909d12', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot e-208 electric hatchback', 'sanitized_make': 'peugeot', 'odometer_in_km': 16597} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 57,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-30t09:45:00z',
'fuel_type': 'electric',
'id': '53ea3436-7d29-5d45-810e-c5b9af909d12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'lr21yjp',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118748001',
'listing': 'auction',
'location': 'aston barclay wakefield',
'make': 'peugeot',
'make_model': 'peugeot e-208 electric hatchback',
'model': 'e-208 electric hatchback',
'odometer': 10313,
'odometer_in_km': 16597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'sanitized_make': 'peugeot',
'seller_name': 'ukcgr - premium',
'title': 'peugeot e-208 electric hatchback 100kw gt premium 50kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '100kw gt premium 50kwh 5dr auto',
'vin': None,
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Electric',
'id': '53ea3436-7d29-5d45-810e-c5b9af909d12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LR21YJP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118748001',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'PEUGEOT',
'model': 'E-208 ELECTRIC HATCHBACK',
'odometer': 10313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seller_name': 'UKCGR - Premium',
'title': 'PEUGEOT E-208 ELECTRIC HATCHBACK 100kW GT Premium 50kWh 5dr Auto',
'transmission': 'automatic',
'trim': '100kW GT Premium 50kWh 5dr Auto',
'vin': None,
'year': 2021}
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118748001%27 HTTP/1.1" 200 None
2026-01-28 19:05:11 [astonbarclay.gb] INFO: Saving data for 118748001: {'auction_closing_time': 1769766300.0, 'created_time': 1768849444.362975, 'last_price_update_time': 1769627111.117005}
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118748001') HTTP/1.1" 204 0
2026-01-28 19:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with identifier: 118988916
2026-01-28 19:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with identifier: 118988916
2026-01-28 19:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2a70f0d4-733a-5bfa-a85c-0384e9d9f627 with identifier: 118988916 to the API
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118988916?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '2a70f0d4-733a-5bfa-a85c-0384e9d9f627',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WR69TXC',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118988916',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'VOLKSWAGEN',
'model': 'POLO HATCHBACK',
'odometer': 60101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-30',
'seller_name': 'UKCGR - Premium',
'title': 'VOLKSWAGEN POLO HATCHBACK 2.0 TSI GTI+ 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TSI GTI+ 5dr DSG',
'vin': None,
'year': 2019}
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118988916%27 HTTP/1.1" 200 None
2026-01-28 19:05:11 [astonbarclay.gb] INFO: Saving data for 118988916: {'created_time': 1769504560.836267, 'last_price_update_time': 1769627111.431762, 'auction_closing_time': 1769766300.0}
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118988916') HTTP/1.1" 204 0
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028a7d0>
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319040c0d0>
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252Faf5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118560200?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118632345?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118962512?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190327050>
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190325990>
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F282e599d-715f-479e-9db3-437da7109031_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319047eed0>
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183735510>
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fc8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Faa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fbdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319063cc10>
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191af4ed0>
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904b4510>
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31916529d0>
2026-01-28 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fc89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319008a810>
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190194e50>
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319051e110>
2026-01-28 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190418750>
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118560200, 'registration': 'BN17OYK', 'account': 'WBA002', 'make': 'HONDA', 'model': 'JAZZ HATCHBACK', 'derivative': '1.3 i-VTEC EX 5dr CVT', 'mileage': 19102, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 350, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-20', 'fuel': 'Petrol', 'motExpiry': '2027-01-08', 'doors': 5, 'engineSize': 1318, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BN17OYK/2026-01-15/image/f24b11c3-7b4a-4e16-a59d-84de8b3fa5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/93297812-ff4b-4d4f-81a1-a510778d5fa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/d51e693a-bf19-488d-9223-17ccc5913a0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/c4b9cc8b-8161-4aec-9d7a-136f2453d97a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/5e543411-a24b-46e4-a3a4-dd2ff2c99aa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/c9c7e862-db53-4388-8c16-792cd0b712bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/880053f6-bf8c-4133-b1c3-a4ae954691a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/d354f301-1101-42c1-b205-41d587886c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/50a2b515-589a-4bca-b9a1-6b580234f69a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18 - 1K, 04/19 - 3K, 07/20 - 4K, 12/20 - 6K, 01/22 - 11K, 10/22 - 11K, 10/24 - 17K', 'remarks': '**642** VOSA STATES 4K, 6K, 8K, 11K, 14K, 17K, 19K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63d30624-563c-43f7-9b6f-58fc3872a68f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118560200, 'registration': 'BN17OYK', 'account': 'WBA002', 'make': 'HONDA', 'model': 'JAZZ HATCHBACK', 'derivative': '1.3 i-VTEC EX 5dr CVT', 'mileage': 19102, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 350, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-20', 'fuel': 'Petrol', 'motExpiry': '2027-01-08', 'doors': 5, 'engineSize': 1318, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BN17OYK/2026-01-15/image/f24b11c3-7b4a-4e16-a59d-84de8b3fa5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/93297812-ff4b-4d4f-81a1-a510778d5fa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/d51e693a-bf19-488d-9223-17ccc5913a0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/c4b9cc8b-8161-4aec-9d7a-136f2453d97a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/5e543411-a24b-46e4-a3a4-dd2ff2c99aa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/c9c7e862-db53-4388-8c16-792cd0b712bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/880053f6-bf8c-4133-b1c3-a4ae954691a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/d354f301-1101-42c1-b205-41d587886c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17OYK/2026-01-15/image/50a2b515-589a-4bca-b9a1-6b580234f69a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18 - 1K, 04/19 - 3K, 07/20 - 4K, 12/20 - 6K, 01/22 - 11K, 10/22 - 11K, 10/24 - 17K', 'remarks': '**642** VOSA STATES 4K, 6K, 8K, 11K, 14K, 17K, 19K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63d30624-563c-43f7-9b6f-58fc3872a68f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f3326a-e281-52aa-a824-b9e51ac3df42 with identifier: 118560200
2026-01-28 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f3326a-e281-52aa-a824-b9e51ac3df42 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f3326a-e281-52aa-a824-b9e51ac3df42 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 97f3326a-e281-52aa-a824-b9e51ac3df42, identifier: 118560200
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118632345, 'registration': 'YE73LUB', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid 3dr', 'mileage': 10864, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 348, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE73LUB/2026-01-15/image/ec58e3ec-80fd-4b74-9a9a-85d7cec742d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/e8ab916e-da36-4c20-9c27-f8ffae8b80d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/8e177535-75ba-4c39-90f1-67249161a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/f0aa9c9b-38ba-440c-86ca-ccd79af0cdf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/e195cf12-ac72-4b5d-abb8-fc6f3120abd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/cf2864c7-1bf5-498f-83ba-ea22573726e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/6db6bbd7-4af3-4d87-8ab2-8bce20cd5def_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/1fe9d1f2-36e6-4918-ac30-82e91327800d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/2ef03fc2-daf4-452e-abb9-df96730f712e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/25 - 6K', 'remarks': '**604** SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c31d16c8-27eb-4992-a4f0-2b82bebd1938.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118632345, 'registration': 'YE73LUB', 'account': 'WBA002', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid 3dr', 'mileage': 10864, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 348, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE73LUB/2026-01-15/image/ec58e3ec-80fd-4b74-9a9a-85d7cec742d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/e8ab916e-da36-4c20-9c27-f8ffae8b80d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/8e177535-75ba-4c39-90f1-67249161a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/f0aa9c9b-38ba-440c-86ca-ccd79af0cdf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/e195cf12-ac72-4b5d-abb8-fc6f3120abd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/cf2864c7-1bf5-498f-83ba-ea22573726e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/6db6bbd7-4af3-4d87-8ab2-8bce20cd5def_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/1fe9d1f2-36e6-4918-ac30-82e91327800d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73LUB/2026-01-15/image/2ef03fc2-daf4-452e-abb9-df96730f712e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/25 - 6K', 'remarks': '**604** SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c31d16c8-27eb-4992-a4f0-2b82bebd1938.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46685d3b-a0bb-53e2-a95b-46e614517d25 with identifier: 118632345
2026-01-28 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46685d3b-a0bb-53e2-a95b-46e614517d25 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46685d3b-a0bb-53e2-a95b-46e614517d25 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46685d3b-a0bb-53e2-a95b-46e614517d25, identifier: 118632345
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118962512, 'registration': 'BT17DRO', 'account': 'WBA002', 'make': 'FORD', 'model': 'GALAXY DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium X 5dr Powershift', 'mileage': 35167, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 356, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BT17DRO/2026-01-26/image/319682e7-cbe1-407c-8fee-282368eea36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/9458bc46-5720-4ebf-b17a-181148615cca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/40474f29-c1c9-4f49-a195-792e21c37df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/610bf19e-95d6-4341-ae2d-f02409934419_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/e3efc2bb-04e4-4d97-8deb-f5ae910723e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/c20f9a5f-a87e-4623-a845-18e2293386ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/71702ebb-48b5-4f8d-8665-296f38289ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/1bf768b9-a749-4c42-afac-fca29d9fd0b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/fe407132-399e-4f74-ac3f-be1a3bd316c0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/19-9K, 06/21-15K, 10/23-19K,', 'remarks': '**593** VOSA STATES 14K, 16K, 18K, 19K, 23K, 33K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81445d3c-654e-4eed-9348-240cfa88103b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118962512, 'registration': 'BT17DRO', 'account': 'WBA002', 'make': 'FORD', 'model': 'GALAXY DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium X 5dr Powershift', 'mileage': 35167, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 356, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BT17DRO/2026-01-26/image/319682e7-cbe1-407c-8fee-282368eea36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/9458bc46-5720-4ebf-b17a-181148615cca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/40474f29-c1c9-4f49-a195-792e21c37df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/610bf19e-95d6-4341-ae2d-f02409934419_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/e3efc2bb-04e4-4d97-8deb-f5ae910723e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/c20f9a5f-a87e-4623-a845-18e2293386ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/71702ebb-48b5-4f8d-8665-296f38289ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/1bf768b9-a749-4c42-afac-fca29d9fd0b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT17DRO/2026-01-26/image/fe407132-399e-4f74-ac3f-be1a3bd316c0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/19-9K, 06/21-15K, 10/23-19K,', 'remarks': '**593** VOSA STATES 14K, 16K, 18K, 19K, 23K, 33K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81445d3c-654e-4eed-9348-240cfa88103b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e661055-bd39-5e98-8424-611cf53236f3 with identifier: 118962512
2026-01-28 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e661055-bd39-5e98-8424-611cf53236f3 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e661055-bd39-5e98-8424-611cf53236f3 with scrape type 2
2026-01-28 19:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4e661055-bd39-5e98-8424-611cf53236f3, identifier: 118962512
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119036841, 'registration': 'FX20LMJ', 'account': 'WBA002', 'make': 'FIAT', 'model': '500C CONVERTIBLE SPECIAL EDITIONS', 'derivative': '1.2 Dolcevita 2dr', 'mileage': 56660, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 357, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-19', 'doors': 2, 'engineSize': 1242, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/21 - 8K, 03/22 - 18K, 03/23 - 25K,', 'remarks': '**423** VOSA STATES 26K, 38K, 50K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bcab1aa0-3b4a-4906-b06a-8b598e64469b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119036841, 'registration': 'FX20LMJ', 'account': 'WBA002', 'make': 'FIAT', 'model': '500C CONVERTIBLE SPECIAL EDITIONS', 'derivative': '1.2 Dolcevita 2dr', 'mileage': 56660, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 357, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-19', 'doors': 2, 'engineSize': 1242, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/21 - 8K, 03/22 - 18K, 03/23 - 25K,', 'remarks': '**423** VOSA STATES 26K, 38K, 50K, SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bcab1aa0-3b4a-4906-b06a-8b598e64469b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b0906ec-f42b-5491-892a-d2777b1226f7 with identifier: 119036841
2026-01-28 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b0906ec-f42b-5491-892a-d2777b1226f7 with scrape type 1
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fbe429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 97f3326a-e281-52aa-a824-b9e51ac3df42 with identifier: 118560200
2026-01-28 19:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 97f3326a-e281-52aa-a824-b9e51ac3df42 with identifier: 118560200
2026-01-28 19:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 97f3326a-e281-52aa-a824-b9e51ac3df42 with identifier: 118560200 to the API
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118560200?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '97f3326a-e281-52aa-a824-b9e51ac3df42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BN17OYK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118560200',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'HONDA',
'model': 'JAZZ HATCHBACK',
'odometer': 19102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-20',
'seller_name': 'UKCGR - Premium',
'title': 'HONDA JAZZ HATCHBACK 1.3 i-VTEC EX 5dr CVT',
'transmission': 'automatic',
'trim': '1.3 i-VTEC EX 5dr CVT',
'vin': None,
'year': 2017}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118560200%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [astonbarclay.gb] INFO: Saving data for 118560200: {'auction_closing_time': 1769766300.0, 'created_time': 1768849439.74236, 'last_price_update_time': 1769627116.259958}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118560200') HTTP/1.1" 204 0
2026-01-28 19:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46685d3b-a0bb-53e2-a95b-46e614517d25 with identifier: 118632345
2026-01-28 19:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46685d3b-a0bb-53e2-a95b-46e614517d25 with identifier: 118632345
2026-01-28 19:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46685d3b-a0bb-53e2-a95b-46e614517d25 with identifier: 118632345 to the API
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2746685d3b-a0bb-53e2-a95b-46e614517d25%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 46685d3b-a0bb-53e2-a95b-46e614517d25: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118632345?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '46685d3b-a0bb-53e2-a95b-46e614517d25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YE73LUB',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118632345',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FIAT',
'model': '500 HATCHBACK',
'odometer': 10864,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seller_name': 'UKCGR - Premium',
'title': 'FIAT 500 HATCHBACK 1.0 Mild Hybrid 3dr',
'transmission': 'manual',
'trim': '1.0 Mild Hybrid 3dr',
'vin': None,
'year': 2023}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118632345%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [astonbarclay.gb] INFO: Saving data for 118632345: {'auction_closing_time': 1769766300.0, 'created_time': 1768417531.568379, 'last_price_update_time': 1769627116.553046}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118632345') HTTP/1.1" 204 0
2026-01-28 19:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4e661055-bd39-5e98-8424-611cf53236f3 with identifier: 118962512
2026-01-28 19:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4e661055-bd39-5e98-8424-611cf53236f3 with identifier: 118962512
2026-01-28 19:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4e661055-bd39-5e98-8424-611cf53236f3 with identifier: 118962512 to the API
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274e661055-bd39-5e98-8424-611cf53236f3%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4e661055-bd39-5e98-8424-611cf53236f3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118962512?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Diesel',
'id': '4e661055-bd39-5e98-8424-611cf53236f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BT17DRO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118962512',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'GALAXY DIESEL ESTATE',
'odometer': 35167,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-17',
'seller_name': 'UKCGR - Premium',
'title': 'FORD GALAXY DIESEL ESTATE 2.0 TDCi 150 Titanium X 5dr Powershift',
'transmission': 'automatic',
'trim': '2.0 TDCi 150 Titanium X 5dr Powershift',
'vin': None,
'year': 2017}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118962512%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [astonbarclay.gb] INFO: Saving data for 118962512: {'auction_closing_time': 1769766300.0, 'created_time': 1769281270.598107, 'last_price_update_time': 1769627116.832029}
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118962512') HTTP/1.1" 204 0
2026-01-28 19:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fe8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fe15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191810f50>
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190071590>
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fe3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190390b10>
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190499190>
2026-01-28 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a3d10>
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119063729?view=catalogue)
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119088482?view=catalogue)
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118953496?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190341750>
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Ffd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190538590>
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fde221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191883e50>
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Ff5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119052700, 'registration': 'AX19FYN', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D180 R-Dynamic SE 5dr Auto', 'mileage': 81312, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 349, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-01', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/21- 13K, 02/23- 26K, 12/24- 63K,', 'remarks': '**446**VOSA STATES 21K, 26K, 52K, 70K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6fc8b1f-41d9-4a86-bc75-e246f98b0154.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119052700, 'registration': 'AX19FYN', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D180 R-Dynamic SE 5dr Auto', 'mileage': 81312, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 349, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-01', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/21- 13K, 02/23- 26K, 12/24- 63K,', 'remarks': '**446**VOSA STATES 21K, 26K, 52K, 70K SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6fc8b1f-41d9-4a86-bc75-e246f98b0154.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50a3d0e-5890-5138-b37c-8900e2043e96 with identifier: 119052700
2026-01-28 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50a3d0e-5890-5138-b37c-8900e2043e96 with scrape type 1
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252Fc63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904d51d0>
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319163e350>
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYJ73WLG%252F2026-01-28%252Fimage%252F1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f
2026-01-28 19:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f, skipping ID generation
2026-01-28 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with scrape type 1
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f from tracking dictionaries
2026-01-28 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f sending to next pipeline
2026-01-28 19:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f, identifier: 119063729
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191a07fd0>
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190498210>
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319008f6d0>
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Faa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319174cc50>
2026-01-28 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fbdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919de710>
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252F01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190500850>
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK73MLL%252F2026-01-28%252Fimage%252Fe5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfb176dd-4953-5bcb-962d-a6ec7e68730d
2026-01-28 19:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfb176dd-4953-5bcb-962d-a6ec7e68730d, skipping ID generation
2026-01-28 19:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb176dd-4953-5bcb-962d-a6ec7e68730d with scrape type 1
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bfb176dd-4953-5bcb-962d-a6ec7e68730d from tracking dictionaries
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfb176dd-4953-5bcb-962d-a6ec7e68730d sending to next pipeline
2026-01-28 19:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bfb176dd-4953-5bcb-962d-a6ec7e68730d, identifier: 119088482
2026-01-28 19:05:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118953496, 'registration': 'DF72FHV', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '3.0 D350 Autobiography LWB 4dr Auto [7 Seat]', 'mileage': 36939, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 342, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-16', 'fuel': 'Diesel', 'motExpiry': '2026-12-15', 'doors': 4, 'engineSize': 2997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DF72FHV/2026-01-26/image/53e60469-f089-4dc8-b3f9-99d3307e1cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/34f6d50c-3bf5-4c9b-bad5-cc0867ed6363_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/276cc55c-c27f-4020-be99-f3c69cecd3f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/27e00f5f-f5fb-4cbc-8f03-faa56d25f2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/28cb826f-c6ce-42b6-9fcc-1d6e4e27d9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/afc0c5b5-6097-40d2-93e4-91147792f970_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/aab03cba-2c28-42f0-91ce-69e52e7ed027_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/6abadac3-473d-4214-93c7-da94a031a015_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/fb258706-c8a7-4ec9-93c6-6d50e727f90e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/25 - 23K', 'remarks': '**772** VOSA STATES 36K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 213, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb982c96-d217-4c93-8575-2a154b1f07dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118953496, 'registration': 'DF72FHV', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '3.0 D350 Autobiography LWB 4dr Auto [7 Seat]', 'mileage': 36939, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 342, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-16', 'fuel': 'Diesel', 'motExpiry': '2026-12-15', 'doors': 4, 'engineSize': 2997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DF72FHV/2026-01-26/image/53e60469-f089-4dc8-b3f9-99d3307e1cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/34f6d50c-3bf5-4c9b-bad5-cc0867ed6363_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/276cc55c-c27f-4020-be99-f3c69cecd3f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/27e00f5f-f5fb-4cbc-8f03-faa56d25f2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/28cb826f-c6ce-42b6-9fcc-1d6e4e27d9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/afc0c5b5-6097-40d2-93e4-91147792f970_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/aab03cba-2c28-42f0-91ce-69e52e7ed027_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/6abadac3-473d-4214-93c7-da94a031a015_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF72FHV/2026-01-26/image/fb258706-c8a7-4ec9-93c6-6d50e727f90e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/25 - 23K', 'remarks': '**772** VOSA STATES 36K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 213, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb982c96-d217-4c93-8575-2a154b1f07dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with identifier: 118953496
2026-01-28 19:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with scrape type 2
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with scrape type 2
2026-01-28 19:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49eeceaf-83bf-56a2-a85f-2ad6254cf731, identifier: 118953496
2026-01-28 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with identifier: 119063729
2026-01-28 19:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with identifier: 119063729
2026-01-28 19:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1bc53df8-77c8-5892-94dc-8d1c4f69bf6f with identifier: 119063729 to the API
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': '1bc53df8-77c8-5892-94dc-8d1c4f69bf6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YJ73WLG',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119063729',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'MAZDA',
'model': 'CX-30 HATCHBACK',
'odometer': 12536,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36491,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/e4bc220f-e7f9-4fa5-b6ee-df56b477761c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36931,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/c5f57aa8-02ee-43b2-b64d-069b45ee3698_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38149,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2a8cfa3c-17d1-483d-b977-5f19eb4f543a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37829,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/773d5ff7-bf91-45d2-b022-0823bde4ff34_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25164,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/092327ea-211c-40e7-9beb-71d65f91e4c7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/93d359d5-9117-446b-bce3-354eece072d5_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43010,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/1e623f16-f2e8-49ae-aa71-5492a773affc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50666,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/2c5e1694-8fc5-46ce-867f-235e77f3decd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bc53df8-77c8-5892-94dc-8d1c4f69bf6f/1bc53df8-77c8-5892-94dc-8d1c4f69bf6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52633,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YJ73WLG/2026-01-28/image/268bcd94-09c3-4197-a6b5-872bc1428fbe_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-09',
'seller_name': 'Motability Operations',
'title': 'MAZDA CX-30 HATCHBACK 2.0 e-Skyactiv G MHEV Centre-Line 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 e-Skyactiv G MHEV Centre-Line 5dr Auto',
'vin': None,
'year': 2023}
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119063729%27 HTTP/1.1" 200 None
2026-01-28 19:05:22 [astonbarclay.gb] INFO: Saving data for 119063729: {'created_time': 1769627122.469686, 'last_price_update_time': 1769627122.469695, 'auction_closing_time': 1770114600.0}
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119063729') HTTP/1.1" 204 0
2026-01-28 19:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bfb176dd-4953-5bcb-962d-a6ec7e68730d with identifier: 119088482
2026-01-28 19:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bfb176dd-4953-5bcb-962d-a6ec7e68730d with identifier: 119088482
2026-01-28 19:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bfb176dd-4953-5bcb-962d-a6ec7e68730d with identifier: 119088482 to the API
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 164,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-02-03T10:30:00Z',
'fuel_type': 'Petrol',
'id': 'bfb176dd-4953-5bcb-962d-a6ec7e68730d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'WK73MLL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119088482',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'SKODA',
'model': 'KODIAQ ESTATE',
'odometer': 24897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38076,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5a7479f-c8d4-47e9-aed2-6c93ba12e09a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39295,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/028770b8-b861-4c67-925b-a83ee1ea4613_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38202,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/01cfbb84-1811-4a44-869c-bf77e9513b02_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36788,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/236b6ccf-d45d-4b6e-ac85-d68d8d5509e3_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54522,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c8fec498-5567-4efc-8711-f6e6fed9dda8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61923,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/c89ab277-04a0-4072-b857-0c3e158ae281_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62182,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/e5e38038-5007-4f9f-923a-9768d1b5ede6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb176dd-4953-5bcb-962d-a6ec7e68730d/bfb176dd-4953-5bcb-962d-a6ec7e68730d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52139,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/WK73MLL/2026-01-28/image/fd6e31a1-0572-42d6-a816-604844099dfc_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-30',
'seller_name': 'Motability Operations',
'title': 'SKODA KODIAQ ESTATE 1.5 TSI SE L Executive 5dr DSG [7 Seat]',
'transmission': 'automatic',
'trim': '1.5 TSI SE L Executive 5dr DSG [7 Seat]',
'vin': None,
'year': 2023}
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119088482%27 HTTP/1.1" 200 None
2026-01-28 19:05:22 [astonbarclay.gb] INFO: Saving data for 119088482: {'created_time': 1769627122.824664, 'last_price_update_time': 1769627122.824679, 'auction_closing_time': 1770114600.0}
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119088482') HTTP/1.1" 204 0
2026-01-28 19:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with identifier: 118953496
2026-01-28 19:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with identifier: 118953496
2026-01-28 19:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 49eeceaf-83bf-56a2-a85f-2ad6254cf731 with identifier: 118953496 to the API
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2749eeceaf-83bf-56a2-a85f-2ad6254cf731%27 HTTP/1.1" 200 None
2026-01-28 19:05:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 49eeceaf-83bf-56a2-a85f-2ad6254cf731: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118953496?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 213,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Diesel',
'id': '49eeceaf-83bf-56a2-a85f-2ad6254cf731',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'DF72FHV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118953496',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'RANGE ROVER DIESEL ESTATE',
'odometer': 36939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-16',
'seller_name': 'UKCGR - Premium',
'title': 'LAND ROVER RANGE ROVER DIESEL ESTATE 3.0 D350 Autobiography LWB 4dr '
'Auto [7 Seat]',
'transmission': 'automatic',
'trim': '3.0 D350 Autobiography LWB 4dr Auto [7 Seat]',
'vin': None,
'year': 2022}
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118953496%27 HTTP/1.1" 200 None
2026-01-28 19:05:23 [astonbarclay.gb] INFO: Saving data for 118953496: {'auction_closing_time': 1769766300.0, 'created_time': 1769281259.316218, 'last_price_update_time': 1769627123.143324}
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118953496') HTTP/1.1" 204 0
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118964467?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036683?view=catalogue)
2026-01-28 19:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252Fc9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117831410?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118538156?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fb5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902111d0>
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252Faf5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904d42d0>
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902777d0>
2026-01-28 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252F889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190058850>
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837dbbd0>
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183628d10>
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901a9bd0>
2026-01-28 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252Fe15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183629c10>
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 119055092, 'registration': 'YW19TZS', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK SPECIAL EDITION', 'derivative': '1.5 VTi-TECH Limited Edition 5dr', 'mileage': 46204, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 340, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-06-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 21K, 30K, 37K, 43K,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc506ba4-5b04-4cdc-983e-efd2bcd28982.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 119055092, 'registration': 'YW19TZS', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK SPECIAL EDITION', 'derivative': '1.5 VTi-TECH Limited Edition 5dr', 'mileage': 46204, 'mileageWarranty': True, 'type': 'car', 'saleId': 18037, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 424}, 'saleStart': '2026-01-30T09:45Z', 'lot': 340, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-06-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 21K, 30K, 37K, 43K,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc506ba4-5b04-4cdc-983e-efd2bcd28982.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with identifier: 119055092
2026-01-28 19:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with scrape type 1
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319011e3d0>
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fe8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119099618?view=catalogue)
2026-01-28 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837df950>
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX67OHF%252F2026-01-26%252Fimage%252F43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55
2026-01-28 19:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55, skipping ID generation
2026-01-28 19:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with scrape type 1
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 from tracking dictionaries
2026-01-28 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 sending to next pipeline
2026-01-28 19:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55, identifier: 118964467
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190058590>
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319011fd90>
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319047fa90>
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028a290>
2026-01-28 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374a3d0>
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190469e90>
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TVN%252F2026-01-28%252Fimage%252F49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7420bbfb-ade6-5f8b-a529-0b3c62855060
2026-01-28 19:05:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7420bbfb-ade6-5f8b-a529-0b3c62855060, skipping ID generation
2026-01-28 19:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7420bbfb-ade6-5f8b-a529-0b3c62855060 with scrape type 1
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7420bbfb-ade6-5f8b-a529-0b3c62855060 from tracking dictionaries
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7420bbfb-ade6-5f8b-a529-0b3c62855060 sending to next pipeline
2026-01-28 19:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7420bbfb-ade6-5f8b-a529-0b3c62855060, identifier: 119036683
2026-01-28 19:05:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117831410, 'registration': 'RJ72YYZ', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 111852, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 365, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/4732d275-2772-4a18-85d5-f001765b59d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/1d70736f-97e9-4343-ba49-17b87f5e703f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/5d0c190a-ffb6-4151-b22b-8a0bfdc92ef1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/c3979093-102b-43cd-a125-cb2cef314f97_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/de005b68-28f1-4025-b524-a24e67bfe102_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/42041048-0301-48b1-89d7-7e7506f2230b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/a6ae809c-e5ec-424e-a169-43dde6f435bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/dc32c840-37f9-43a5-8dd4-964d52ca24cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/f917b0e1-35be-44f0-b6c3-00cb327a36ab_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/24 40k 04/25 80k', 'remarks': 'SPARE KEY Ex-Private Hire, VOSA STATES 14K 30K 47K 75K 92K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f302c12-d5f9-4c25-a691-1fb85c16b0eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117831410, 'registration': 'RJ72YYZ', 'account': 'ADD002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]', 'mileage': 111852, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 365, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-07-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/4732d275-2772-4a18-85d5-f001765b59d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/1d70736f-97e9-4343-ba49-17b87f5e703f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/5d0c190a-ffb6-4151-b22b-8a0bfdc92ef1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/c3979093-102b-43cd-a125-cb2cef314f97_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/de005b68-28f1-4025-b524-a24e67bfe102_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/42041048-0301-48b1-89d7-7e7506f2230b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/a6ae809c-e5ec-424e-a169-43dde6f435bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/dc32c840-37f9-43a5-8dd4-964d52ca24cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ72YYZ/2025-12-16/image/f917b0e1-35be-44f0-b6c3-00cb327a36ab_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/24 40k 04/25 80k', 'remarks': 'SPARE KEY Ex-Private Hire, VOSA STATES 14K 30K 47K 75K 92K', 'virtual': False, 'seller': 'Addison Lee', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f302c12-d5f9-4c25-a691-1fb85c16b0eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a7ae72-86ee-528f-9be0-773af8184c8c with identifier: 117831410
2026-01-28 19:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a7ae72-86ee-528f-9be0-773af8184c8c with scrape type 2
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a7ae72-86ee-528f-9be0-773af8184c8c with scrape type 2
2026-01-28 19:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e3a7ae72-86ee-528f-9be0-773af8184c8c, identifier: 117831410
2026-01-28 19:05:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118538156, 'registration': 'FN74NTV', 'account': 'MIN015', 'make': 'SKODA', 'model': 'SUPERB DIESEL ESTATE', 'derivative': '2.0 TDI SE Technology 5dr DSG', 'mileage': 12747, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 360, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FN74NTV/2026-01-22/image/9011b365-4c67-4491-8a01-3e7936748c7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/dd3416f5-43df-4938-a548-11a3a50e21c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/746f68c7-33bb-4b14-9013-69a9ef5f5340_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/3f4475c5-6eb6-4fbf-ba0f-3faa3751d313_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/0e096378-06e7-4787-b2b2-55f40b2f4a62_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/4218e377-46b6-4152-949e-ebbdf9b245e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/a43f1ad7-9f0e-41b7-85f9-75d2d3457c0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/623b3dbf-b185-43ad-a69e-5cd945475a8c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mint Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/456d4c3c-e0c2-48c6-805d-61f5a63cd350.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118538156, 'registration': 'FN74NTV', 'account': 'MIN015', 'make': 'SKODA', 'model': 'SUPERB DIESEL ESTATE', 'derivative': '2.0 TDI SE Technology 5dr DSG', 'mileage': 12747, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 360, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FN74NTV/2026-01-22/image/9011b365-4c67-4491-8a01-3e7936748c7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/dd3416f5-43df-4938-a548-11a3a50e21c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/746f68c7-33bb-4b14-9013-69a9ef5f5340_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/3f4475c5-6eb6-4fbf-ba0f-3faa3751d313_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/0e096378-06e7-4787-b2b2-55f40b2f4a62_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/4218e377-46b6-4152-949e-ebbdf9b245e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/a43f1ad7-9f0e-41b7-85f9-75d2d3457c0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN74NTV/2026-01-22/image/623b3dbf-b185-43ad-a69e-5cd945475a8c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mint Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/456d4c3c-e0c2-48c6-805d-61f5a63cd350.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0522516e-aa9e-5f0f-afba-d1464d32c715 with identifier: 118538156
2026-01-28 19:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0522516e-aa9e-5f0f-afba-d1464d32c715 with scrape type 2
2026-01-28 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0522516e-aa9e-5f0f-afba-d1464d32c715 with scrape type 2
2026-01-28 19:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0522516e-aa9e-5f0f-afba-d1464d32c715, identifier: 118538156
2026-01-28 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fb4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with identifier: 118964467
2026-01-28 19:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with identifier: 118964467
2026-01-28 19:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 21675ab1-6f83-5d0b-8e91-fad2ffb84a55 with identifier: 118964467 to the API
2026-01-28 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-02-02T17:30:00Z',
'fuel_type': 'Petrol',
'id': '21675ab1-6f83-5d0b-8e91-fad2ffb84a55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'LX67OHF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118964467',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 67421,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39678,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6ee855c7-9b3e-4eb4-b0ee-bbda0fcbdb7b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42547,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/6acc9e3a-1ca2-4dd1-854d-6d1856182ad1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38401,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/0ba3a400-ff31-4302-9be7-76f72266f3ad_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40024,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/77f486dc-0155-45aa-be43-40afc17024eb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31209,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/4741a50f-5995-4db6-b528-eaf400d18979_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52364,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/af5c7e15-32a7-4baa-a63b-192e4290e60c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36867,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/9cc3984d-2386-4fd8-af44-54e8343f151b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32284,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/43c61b98-15ed-4ac2-94c0-2285cc52463a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42822,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/42f0869b-e854-4fe1-87db-42cee7aa6879_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21675ab1-6f83-5d0b-8e91-fad2ffb84a55/21675ab1-6f83-5d0b-8e91-fad2ffb84a55_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51332,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/LX67OHF/2026-01-26/image/845d4504-e563-44eb-bcc2-72e2613c662c_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-20',
'seller_name': 'Zero pricing',
'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
'transmission': 'manual',
'trim': '1.2 DiG-T N-Connecta 5dr',
'vin': None,
'year': 2017}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118964467%27 HTTP/1.1" 200 None
2026-01-28 19:05:29 [astonbarclay.gb] INFO: Saving data for 118964467: {'created_time': 1769627129.319958, 'last_price_update_time': 1769627129.319968, 'auction_closing_time': 1770053400.0}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118964467') HTTP/1.1" 204 0
2026-01-28 19:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7420bbfb-ade6-5f8b-a529-0b3c62855060 with identifier: 119036683
2026-01-28 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7420bbfb-ade6-5f8b-a529-0b3c62855060 with identifier: 119036683
2026-01-28 19:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7420bbfb-ade6-5f8b-a529-0b3c62855060 with identifier: 119036683 to the API
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '7420bbfb-ade6-5f8b-a529-0b3c62855060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YG20TVN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119036683',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FORD',
'model': 'FIESTA HATCHBACK',
'odometer': 30188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31943,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/02be0743-d0fb-4634-85a1-d42fdba662d4_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31145,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/9544f3c6-097b-4f3c-b06d-0d49317c592b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32653,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/7b801453-2fd5-4489-b2ed-e53201b276aa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32745,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/f5ca41d5-8c16-4375-b722-07e9839096cd_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39953,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/de221228-b3b5-4155-8f84-af31fab3e024_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56511,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/59ba8c69-e99e-448b-916d-3a66c000841c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42785,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/bdb5c65d-130a-44ca-a246-2d49f1755e35_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42762,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/49e78fa3-b717-4820-8bde-f2083c86b774_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7420bbfb-ade6-5f8b-a529-0b3c62855060/7420bbfb-ade6-5f8b-a529-0b3c62855060_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46330,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YG20TVN/2026-01-28/image/e15b959a-ff95-48b0-929c-3c8fbe316e5a_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-07',
'seller_name': 'UKCGR - Premium',
'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 95 ST-Line Edition 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost 95 ST-Line Edition 5dr',
'vin': None,
'year': 2020}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036683%27 HTTP/1.1" 200 None
2026-01-28 19:05:29 [astonbarclay.gb] INFO: Saving data for 119036683: {'created_time': 1769627129.682573, 'last_price_update_time': 1769627129.682583, 'auction_closing_time': 1769766300.0}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119036683') HTTP/1.1" 204 0
2026-01-28 19:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e3a7ae72-86ee-528f-9be0-773af8184c8c with identifier: 117831410
2026-01-28 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e3a7ae72-86ee-528f-9be0-773af8184c8c with identifier: 117831410
2026-01-28 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180007 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180007
2026-01-28 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e3a7ae72-86ee-528f-9be0-773af8184c8c spider: astonbarclay.gb
2026-01-28 19:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e3a7ae72-86ee-528f-9be0-773af8184c8c due to rule: high_mileage_for_country.json, error: 180007 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
180007
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'e3a7ae72-86ee-528f-9be0-773af8184c8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ72YYZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117831410',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 111852,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': 'Addison Lee',
'title': 'VOLKSWAGEN ID.4 ESTATE 128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'transmission': 'automatic',
'trim': '128kW Life Pro 77kWh 5dr Auto [135kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117831410%27 HTTP/1.1" 200 None
2026-01-28 19:05:29 [astonbarclay.gb] INFO: Saving data for 117831410: {'auction_closing_time': 1769680800.0, 'created_time': 1767986478.614754, 'last_price_update_time': 1769627129.907429}
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117831410') HTTP/1.1" 204 0
2026-01-28 19:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0522516e-aa9e-5f0f-afba-d1464d32c715 with identifier: 118538156
2026-01-28 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0522516e-aa9e-5f0f-afba-d1464d32c715 with identifier: 118538156
2026-01-28 19:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0522516e-aa9e-5f0f-afba-d1464d32c715 with identifier: 118538156 to the API
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118538156?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0522516e-aa9e-5f0f-afba-d1464d32c715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'FN74NTV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118538156',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'SKODA',
'model': 'SUPERB DIESEL ESTATE',
'odometer': 12747,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-30',
'seller_name': 'Mint Automotive',
'title': 'SKODA SUPERB DIESEL ESTATE 2.0 TDI SE Technology 5dr DSG',
'transmission': 'automatic',
'trim': '2.0 TDI SE Technology 5dr DSG',
'vin': None,
'year': 2024}
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118538156%27 HTTP/1.1" 200 None
2026-01-28 19:05:30 [astonbarclay.gb] INFO: Saving data for 118538156: {'auction_closing_time': 1769680800.0, 'created_time': 1769194941.730828, 'last_price_update_time': 1769627130.197211}
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118538156') HTTP/1.1" 204 0
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119036841?view=catalogue)
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fbb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190301750>
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP68ZPS%252F2026-01-28%252Fimage%252Fbe429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0099a3a-c4a4-58ec-b244-321e4777ccec
2026-01-28 19:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0099a3a-c4a4-58ec-b244-321e4777ccec, skipping ID generation
2026-01-28 19:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0099a3a-c4a4-58ec-b244-321e4777ccec with scrape type 1
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f0099a3a-c4a4-58ec-b244-321e4777ccec from tracking dictionaries
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0099a3a-c4a4-58ec-b244-321e4777ccec sending to next pipeline
2026-01-28 19:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f0099a3a-c4a4-58ec-b244-321e4777ccec, identifier: 119099618
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31900afa50>
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190537fd0>
2026-01-28 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318360e510>
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31901144d0>
2026-01-28 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252Fc63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f0099a3a-c4a4-58ec-b244-321e4777ccec with identifier: 119099618
2026-01-28 19:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f0099a3a-c4a4-58ec-b244-321e4777ccec with identifier: 119099618
2026-01-28 19:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f0099a3a-c4a4-58ec-b244-321e4777ccec with identifier: 119099618 to the API
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'expiration_date': '2026-02-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f0099a3a-c4a4-58ec-b244-321e4777ccec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'KP68ZPS',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119099618',
'listing': 'auction',
'location': 'Aston Barclay Chelmsford',
'make': 'MERCEDES-BENZ',
'model': 'C CLASS DIESEL COUPE',
'odometer': 86346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34940,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/282e599d-715f-479e-9db3-437da7109031_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32064,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/5ac7c801-3926-40f5-908f-754415b6ac20_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32144,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/984f5a6e-df4a-4375-bbc8-c51eb827aa6e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30045,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/776451e5-b945-4f9e-bd00-ca82dbff5497_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43653,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e3d041ec-1a24-41e4-8b7d-31312275149b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51112,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/25450abe-3b11-43b4-b11b-f9205ff3b087_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58847,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/aa7b9627-f833-44e7-9223-b8455dd06082_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50136,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/be429a9a-0ef1-4ea1-b13a-9be42f581497_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40117,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/e8c35778-5ca6-470f-a7ae-0ff606ca0d1f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0099a3a-c4a4-58ec-b244-321e4777ccec/f0099a3a-c4a4-58ec-b244-321e4777ccec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49468,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/KP68ZPS/2026-01-28/image/889b8b88-c9c5-4525-9c33-4b5c8a68ade4_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seller_name': 'Hedin Automotive',
'title': 'MERCEDES-BENZ C CLASS DIESEL COUPE C220d AMG Line Premium 2dr '
'9G-Tronic',
'transmission': 'automatic',
'trim': 'C220d AMG Line Premium 2dr 9G-Tronic',
'vin': None,
'year': 2018}
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119099618%27 HTTP/1.1" 200 None
2026-01-28 19:05:32 [astonbarclay.gb] INFO: Saving data for 119099618: {'created_time': 1769627132.483655, 'last_price_update_time': 1769627132.483665, 'auction_closing_time': 1770026400.0}
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119099618') HTTP/1.1" 204 0
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118501749?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118532216?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118654382?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118963908?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118641866?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117888562?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118974415?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117708882?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190613310>
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31903024d0>
2026-01-28 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252Fc9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190d05910>
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31837deb90>
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190496110>
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fb5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190303ed0>
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX20LMJ%252F2026-01-27%252Fimage%252F10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b0906ec-f42b-5491-892a-d2777b1226f7
2026-01-28 19:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b0906ec-f42b-5491-892a-d2777b1226f7, skipping ID generation
2026-01-28 19:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b0906ec-f42b-5491-892a-d2777b1226f7 with scrape type 1
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9b0906ec-f42b-5491-892a-d2777b1226f7 from tracking dictionaries
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b0906ec-f42b-5491-892a-d2777b1226f7 sending to next pipeline
2026-01-28 19:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b0906ec-f42b-5491-892a-d2777b1226f7, identifier: 119036841
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b0906ec-f42b-5491-892a-d2777b1226f7 with identifier: 119036841
2026-01-28 19:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b0906ec-f42b-5491-892a-d2777b1226f7 with identifier: 119036841
2026-01-28 19:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9b0906ec-f42b-5491-892a-d2777b1226f7 with identifier: 119036841 to the API
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '9b0906ec-f42b-5491-892a-d2777b1226f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FX20LMJ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119036841',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'FIAT',
'model': '500C CONVERTIBLE SPECIAL EDITIONS',
'odometer': 56660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30136,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3ed37f8f-3ca2-4e26-b709-74cb73a56d89_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33235,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/306db8d9-32eb-4bac-a46d-1c6e06972881_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29666,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/77b46204-1d96-4b99-b00f-df64a262cae0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29273,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/02b0ac9f-ea03-4a02-bf94-ecc0eda6cbcf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49481,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/81b23583-9375-40f4-b667-e69fafd830f2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56151,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/6cf58660-4496-4793-82b0-d9beec783d49_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41858,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/3937f2aa-19c7-41d3-847a-5f17afc0976b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48708,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c63d6d2b-24ea-4556-9c60-74436294b903_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51290,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/10e24be9-848f-4358-9dc7-18ff336b5a29_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0906ec-f42b-5491-892a-d2777b1226f7/9b0906ec-f42b-5491-892a-d2777b1226f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31453,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/FX20LMJ/2026-01-27/image/c9e0ddbd-f150-4152-9c46-c63e287ba5ba_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-10',
'seller_name': 'UKCGR - Premium',
'title': 'FIAT 500C CONVERTIBLE SPECIAL EDITIONS 1.2 Dolcevita 2dr',
'transmission': 'manual',
'trim': '1.2 Dolcevita 2dr',
'vin': None,
'year': 2020}
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119036841%27 HTTP/1.1" 200 None
2026-01-28 19:05:34 [astonbarclay.gb] INFO: Saving data for 119036841: {'created_time': 1769627134.764256, 'last_price_update_time': 1769627134.764266, 'auction_closing_time': 1769766300.0}
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119036841') HTTP/1.1" 204 0
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119052700?view=catalogue)
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183784d10>
2026-01-28 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252F85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3183738d90>
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319195c110>
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fb4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190d20190>
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118501749, 'registration': 'MJ69CDN', 'account': 'MOT075', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 86985, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 319, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-11-21', 'fuel': 'Electric', 'motExpiry': '2026-10-03', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/7dc2b596-6303-4c3d-b866-41677dd9d2ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/08a88f49-0394-4178-9eef-f1019ef470e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/8ec2a4b2-1ba4-4d1b-a1c5-619a5990c485_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/b76b6e57-3aa2-4a41-940b-be2ab70b83f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/8eb42ed7-e987-4b77-92c6-9438880b7df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/04d62047-d217-46ac-9a4e-5f19d049a6ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/de389e40-676c-4b65-8fe1-96e0d21d1fd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/4c4a3691-95ef-43dd-ae44-68a79cb7cc76_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/e31642ee-2cc8-4952-9c20-42414dab119c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1719** VOSA STATES 24K, 46K, 63K, 82K, CHARGING CABLE', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb1c9d82-60cc-499f-8584-76dac51683ec.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118501749, 'registration': 'MJ69CDN', 'account': 'MOT075', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 86985, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 319, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-11-21', 'fuel': 'Electric', 'motExpiry': '2026-10-03', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/7dc2b596-6303-4c3d-b866-41677dd9d2ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/08a88f49-0394-4178-9eef-f1019ef470e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/8ec2a4b2-1ba4-4d1b-a1c5-619a5990c485_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/b76b6e57-3aa2-4a41-940b-be2ab70b83f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/8eb42ed7-e987-4b77-92c6-9438880b7df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/04d62047-d217-46ac-9a4e-5f19d049a6ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/de389e40-676c-4b65-8fe1-96e0d21d1fd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/4c4a3691-95ef-43dd-ae44-68a79cb7cc76_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ69CDN/2026-01-12/image/e31642ee-2cc8-4952-9c20-42414dab119c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1719** VOSA STATES 24K, 46K, 63K, 82K, CHARGING CABLE', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb1c9d82-60cc-499f-8584-76dac51683ec.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf with identifier: 118501749
2026-01-28 19:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf with scrape type 2
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf with scrape type 2
2026-01-28 19:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf, identifier: 118501749
2026-01-28 19:05:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118532216, 'registration': 'OY68HMF', 'account': 'MAN027', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.0 TSI SE 5dr', 'mileage': 101170, 'mileageWarranty': False, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 316, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-21', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OY68HMF/2026-01-19/image/3b016618-a11f-4263-a56d-1c26ef729478_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/8bd35cd0-36a8-4dd8-bb01-d924634c00a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/252974c9-13c7-4519-9309-e27fad3d83b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/1e81c519-5893-40e9-8e45-47b190255181_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/2b971b10-031d-40fa-93fc-d49cf7579ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/908dfcbb-5602-4632-a112-02eb4cc3f066_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/0fe3e46c-dbfd-4c43-926f-39793c0586df_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/6633395c-9cc0-41d5-961e-2bf5722c44fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/5057d10e-a489-4e3e-8360-874f700b4219_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/22 - 46K,', 'remarks': '**1688** VOSA STATES 36K, 36K, 46K, 60K, 78K, 99K', 'virtual': True, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/001ff2fb-371b-4bef-bd2e-ed1bc04c18a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118532216, 'registration': 'OY68HMF', 'account': 'MAN027', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.0 TSI SE 5dr', 'mileage': 101170, 'mileageWarranty': False, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 316, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-21', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OY68HMF/2026-01-19/image/3b016618-a11f-4263-a56d-1c26ef729478_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/8bd35cd0-36a8-4dd8-bb01-d924634c00a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/252974c9-13c7-4519-9309-e27fad3d83b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/1e81c519-5893-40e9-8e45-47b190255181_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/2b971b10-031d-40fa-93fc-d49cf7579ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/908dfcbb-5602-4632-a112-02eb4cc3f066_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/0fe3e46c-dbfd-4c43-926f-39793c0586df_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/6633395c-9cc0-41d5-961e-2bf5722c44fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY68HMF/2026-01-19/image/5057d10e-a489-4e3e-8360-874f700b4219_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/22 - 46K,', 'remarks': '**1688** VOSA STATES 36K, 36K, 46K, 60K, 78K, 99K', 'virtual': True, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/001ff2fb-371b-4bef-bd2e-ed1bc04c18a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae429951-df7e-58c1-bbd3-0497f4086137 with identifier: 118532216
2026-01-28 19:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae429951-df7e-58c1-bbd3-0497f4086137 with scrape type 2
2026-01-28 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae429951-df7e-58c1-bbd3-0497f4086137 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ae429951-df7e-58c1-bbd3-0497f4086137, identifier: 118532216
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118654382, 'registration': 'DV22NYP', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 13070, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 315, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22NYP/2026-01-28/image/04f52c10-6d14-4fab-84b4-57e9c2de6ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/17da01eb-17e8-4edb-9cb7-837d11235c34_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/6dc2f42c-c752-4786-8e33-7dd40a86dc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/5a7ffa87-c9da-40ab-93cc-3167da1f59fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/3a83b0b9-905b-4dc1-b99c-f458716e4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/d75d0ba3-7818-489b-80f1-7675bb7b1319_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/7af1d14e-09df-477d-830d-e43398b660b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/e6ca67f8-e814-4530-9019-4cb08f9ff37b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/17afe2f9-c733-4da8-8589-397aa5c7fe61_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'VOSA STATES 11K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59e58835-1c9a-44ba-9571-938741189d8b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118654382, 'registration': 'DV22NYP', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 13070, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 315, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22NYP/2026-01-28/image/04f52c10-6d14-4fab-84b4-57e9c2de6ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/17da01eb-17e8-4edb-9cb7-837d11235c34_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/6dc2f42c-c752-4786-8e33-7dd40a86dc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/5a7ffa87-c9da-40ab-93cc-3167da1f59fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/3a83b0b9-905b-4dc1-b99c-f458716e4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/d75d0ba3-7818-489b-80f1-7675bb7b1319_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/7af1d14e-09df-477d-830d-e43398b660b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/e6ca67f8-e814-4530-9019-4cb08f9ff37b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22NYP/2026-01-28/image/17afe2f9-c733-4da8-8589-397aa5c7fe61_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'VOSA STATES 11K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59e58835-1c9a-44ba-9571-938741189d8b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1996f50d-0e91-5bbe-8983-f97edee3ff9a with identifier: 118654382
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1996f50d-0e91-5bbe-8983-f97edee3ff9a with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1996f50d-0e91-5bbe-8983-f97edee3ff9a with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1996f50d-0e91-5bbe-8983-f97edee3ff9a, identifier: 118654382
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118963908, 'registration': 'FY70VPK', 'account': 'RCI001', 'make': 'KIA', 'model': 'CEED DIESEL HATCHBACK', 'derivative': '1.6 CRDi ISG 2 NAV 5dr', 'mileage': 24325, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 325, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-01-07', 'fuel': 'Diesel', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY70VPK/2026-01-27/image/7b4796cb-0196-497d-98e5-5b74e5a97982_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/846634d9-e19c-48f8-80a0-d9a47cdd173e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/8af3fb81-1a7d-4153-a6da-5ebf4be4622b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/5d0095f8-0413-4366-bd90-c57cbc54ff7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/16261d19-c04d-4149-bbb3-295c3b19e4ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/98e78501-33e7-4967-bac7-b07c5583e537_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/c469d44f-a4fb-40e1-8709-34f9f5b4a2be_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/1b3f8396-6f05-4387-bb1f-4a47891ad644_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/d63e740d-d0bb-461c-9234-969621d1482d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/abf942c4-dc98-472b-8b21-86a77e224cf4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/22 6K 07/24 20K 0/25 22K', 'remarks': 'VOSA STATES 18K 18K 21K 23K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/577bc962-ada2-4dff-8671-55417d114633.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118963908, 'registration': 'FY70VPK', 'account': 'RCI001', 'make': 'KIA', 'model': 'CEED DIESEL HATCHBACK', 'derivative': '1.6 CRDi ISG 2 NAV 5dr', 'mileage': 24325, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 325, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-01-07', 'fuel': 'Diesel', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY70VPK/2026-01-27/image/7b4796cb-0196-497d-98e5-5b74e5a97982_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/846634d9-e19c-48f8-80a0-d9a47cdd173e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/8af3fb81-1a7d-4153-a6da-5ebf4be4622b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/5d0095f8-0413-4366-bd90-c57cbc54ff7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/16261d19-c04d-4149-bbb3-295c3b19e4ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/98e78501-33e7-4967-bac7-b07c5583e537_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/c469d44f-a4fb-40e1-8709-34f9f5b4a2be_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/1b3f8396-6f05-4387-bb1f-4a47891ad644_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/d63e740d-d0bb-461c-9234-969621d1482d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY70VPK/2026-01-27/image/abf942c4-dc98-472b-8b21-86a77e224cf4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/22 6K 07/24 20K 0/25 22K', 'remarks': 'VOSA STATES 18K 18K 21K 23K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/577bc962-ada2-4dff-8671-55417d114633.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with identifier: 118963908
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0a977919-2785-5fdc-9aeb-2984b52bcfd5, identifier: 118963908
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118641866, 'registration': 'AY68YKV', 'account': 'MOT075', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Dynamique S Nav 5dr', 'mileage': 107169, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 321, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-22', 'fuel': 'Petrol', 'motExpiry': '2026-12-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AY68YKV/2026-01-15/image/8dd1a5b4-a279-42b7-a0f3-38c777e8a573_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/217db588-e465-4018-b2ff-7b1e51af24ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/17c13de1-e398-4cac-832e-94e872881c64_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/cea7368e-ba6e-47ec-addd-c6f12332917f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/ba196a37-f14d-4da7-ab34-d1793a7c431c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/db14a7de-4d84-46ad-91c0-1f68c789eca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/670cc871-6a87-4a94-bcdf-9fdd5a2d4664_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/bfb37291-f83f-4d17-8f02-ce208ca5e451_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/1b390a9f-515e-4d57-b066-c7e132565600_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1460** VOSA STATES 66K, 71K, 84K, 93K, 106K,', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d14763-6765-450c-bb41-409d23e4cbd6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118641866, 'registration': 'AY68YKV', 'account': 'MOT075', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Dynamique S Nav 5dr', 'mileage': 107169, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 321, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-22', 'fuel': 'Petrol', 'motExpiry': '2026-12-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AY68YKV/2026-01-15/image/8dd1a5b4-a279-42b7-a0f3-38c777e8a573_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/217db588-e465-4018-b2ff-7b1e51af24ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/17c13de1-e398-4cac-832e-94e872881c64_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/cea7368e-ba6e-47ec-addd-c6f12332917f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/ba196a37-f14d-4da7-ab34-d1793a7c431c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/db14a7de-4d84-46ad-91c0-1f68c789eca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/670cc871-6a87-4a94-bcdf-9fdd5a2d4664_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/bfb37291-f83f-4d17-8f02-ce208ca5e451_removebg.jpg?w=600', 'https://abimg003.imgix.net/AY68YKV/2026-01-15/image/1b390a9f-515e-4d57-b066-c7e132565600_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1460** VOSA STATES 66K, 71K, 84K, 93K, 106K,', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d14763-6765-450c-bb41-409d23e4cbd6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecafd03c-a95b-5f96-9738-079ad9e4ade1 with identifier: 118641866
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecafd03c-a95b-5f96-9738-079ad9e4ade1 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecafd03c-a95b-5f96-9738-079ad9e4ade1 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ecafd03c-a95b-5f96-9738-079ad9e4ade1, identifier: 118641866
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117888562, 'registration': 'GF72BLZ', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Tekna 5dr', 'mileage': 40291, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 320, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-09-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/cc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/25 33K', 'remarks': 'NEW BATTERY FITTED - ALARM SOUNDS WHEN RUNNING - MAY HAVE FURTHER ISSUES, VOSA STATES 38K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0db19d40-b9d2-4468-a512-2b33538c2a93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117888562, 'registration': 'GF72BLZ', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Tekna 5dr', 'mileage': 40291, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 320, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-09-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/cc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/25 33K', 'remarks': 'NEW BATTERY FITTED - ALARM SOUNDS WHEN RUNNING - MAY HAVE FURTHER ISSUES, VOSA STATES 38K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0db19d40-b9d2-4468-a512-2b33538c2a93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 220e0619-4660-5b87-a5f0-427f38f2a6c1 with identifier: 117888562
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220e0619-4660-5b87-a5f0-427f38f2a6c1 with scrape type 1
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 220e0619-4660-5b87-a5f0-427f38f2a6c1
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252F7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252Fcc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/cc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252F39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252Fa5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252F693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252Fa8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252F35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF72BLZ%252F2025-12-16%252Fimage%252F58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg?w=600 already downloaded
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 220e0619-4660-5b87-a5f0-427f38f2a6c1, identifier: 117888562
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118974415, 'registration': 'FX72YJL', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 10374, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 314, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FX72YJL/2026-01-28/image/b5ba0468-3c69-4341-a060-907b8299ccb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/985e0c4a-781a-4650-be6e-d548bd44df2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/cbc7d0d2-1635-4e23-8d85-bc7bb83a3227_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/9729f781-0d0d-44cc-bd03-adb23b0709e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/92ae3cf8-9c0f-45c7-bd1d-3786fb4c5aa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/7bcb59fb-4652-42e1-87f5-8ad1c500c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/2f710b6d-531e-47ef-a587-0f392069a065_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/b14ac7a8-e0d1-4e97-94ba-e2b7726cce6f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 9K', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118974415, 'registration': 'FX72YJL', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 10374, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 314, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FX72YJL/2026-01-28/image/b5ba0468-3c69-4341-a060-907b8299ccb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/985e0c4a-781a-4650-be6e-d548bd44df2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/cbc7d0d2-1635-4e23-8d85-bc7bb83a3227_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/9729f781-0d0d-44cc-bd03-adb23b0709e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/92ae3cf8-9c0f-45c7-bd1d-3786fb4c5aa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/7bcb59fb-4652-42e1-87f5-8ad1c500c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/2f710b6d-531e-47ef-a587-0f392069a065_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72YJL/2026-01-28/image/b14ac7a8-e0d1-4e97-94ba-e2b7726cce6f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 9K', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20cddb2e-c221-502e-bbf8-cefb318653fc with identifier: 118974415
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20cddb2e-c221-502e-bbf8-cefb318653fc with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20cddb2e-c221-502e-bbf8-cefb318653fc with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20cddb2e-c221-502e-bbf8-cefb318653fc, identifier: 118974415
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117708882, 'registration': 'RE22FBN', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto [110kW Ch]', 'mileage': 53856, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 357, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-12', 'fuel': 'Electric', 'motExpiry': '2026-07-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RE22FBN/2026-01-14/image/dc16b1e9-6ebc-4aa5-a913-cf6d6aab4f81_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/4b5b7613-0d01-40e3-96d6-2e800e8232e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/f5a9112e-1d87-42c7-b107-6bbf57535dfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/3a1ef717-3428-4a7b-a41c-3a2c6b3a7915_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/b55057db-747c-44e1-843e-a364937fc4a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/94bf9183-c73e-4087-b025-a7f9e47970b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/e93c2c0d-7b27-47e8-bc2c-10aa34a77bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/a8c9a45f-e4be-42ac-b5a6-7c0633ea46a5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-33k,', 'remarks': 'SPARE KEY, *Metallic - Mythos black, Art velours microfleece cloth - Soul black/Platinum grey with Platinum grey/Soul / Assistance pack - ID.4 / Rear view camera (stnd in Assistance pack)*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf8116be-2b39-4546-adb1-0d0c3eb05dbb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117708882, 'registration': 'RE22FBN', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto [110kW Ch]', 'mileage': 53856, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 357, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-12', 'fuel': 'Electric', 'motExpiry': '2026-07-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RE22FBN/2026-01-14/image/dc16b1e9-6ebc-4aa5-a913-cf6d6aab4f81_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/4b5b7613-0d01-40e3-96d6-2e800e8232e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/f5a9112e-1d87-42c7-b107-6bbf57535dfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/3a1ef717-3428-4a7b-a41c-3a2c6b3a7915_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/b55057db-747c-44e1-843e-a364937fc4a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/94bf9183-c73e-4087-b025-a7f9e47970b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/e93c2c0d-7b27-47e8-bc2c-10aa34a77bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22FBN/2026-01-14/image/a8c9a45f-e4be-42ac-b5a6-7c0633ea46a5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-33k,', 'remarks': 'SPARE KEY, *Metallic - Mythos black, Art velours microfleece cloth - Soul black/Platinum grey with Platinum grey/Soul / Assistance pack - ID.4 / Rear view camera (stnd in Assistance pack)*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf8116be-2b39-4546-adb1-0d0c3eb05dbb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57366c8-a516-5032-b66f-9e9a4244f4b2 with identifier: 117708882
2026-01-28 19:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57366c8-a516-5032-b66f-9e9a4244f4b2 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57366c8-a516-5032-b66f-9e9a4244f4b2 with scrape type 2
2026-01-28 19:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f57366c8-a516-5032-b66f-9e9a4244f4b2, identifier: 117708882
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf with identifier: 118501749
2026-01-28 19:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf with identifier: 118501749
2026-01-28 19:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139988 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
139988
2026-01-28 19:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf spider: astonbarclay.gb
2026-01-28 19:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf due to rule: high_mileage_for_make.json, error: 139988 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
139988
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '9d1c52fe-d8a4-501e-bd0b-e47040b9f0bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MJ69CDN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118501749',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'TESLA',
'model': 'MODEL 3 SALOON',
'odometer': 86985,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seller_name': 'MotoNovo Finance',
'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
'transmission': 'automatic',
'trim': 'Long Range AWD 4dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118501749%27 HTTP/1.1" 200 None
2026-01-28 19:05:36 [astonbarclay.gb] INFO: Saving data for 118501749: {'auction_closing_time': 1769680800.0, 'created_time': 1767987476.205226, 'last_price_update_time': 1769627136.975915}
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118501749') HTTP/1.1" 204 0
2026-01-28 19:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ae429951-df7e-58c1-bbd3-0497f4086137 with identifier: 118532216
2026-01-28 19:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ae429951-df7e-58c1-bbd3-0497f4086137 with identifier: 118532216
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162816 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162816
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ae429951-df7e-58c1-bbd3-0497f4086137 spider: astonbarclay.gb
2026-01-28 19:05:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ae429951-df7e-58c1-bbd3-0497f4086137 due to rule: high_mileage_for_country.json, error: 162816 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162816
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ae429951-df7e-58c1-bbd3-0497f4086137',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'OY68HMF',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118532216',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'VOLKSWAGEN',
'model': 'T-ROC HATCHBACK',
'odometer': 101170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-21',
'seller_name': 'Mann Island Finance',
'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.0 TSI SE 5dr',
'transmission': 'manual',
'trim': '1.0 TSI SE 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118532216%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [astonbarclay.gb] INFO: Saving data for 118532216: {'auction_closing_time': 1769680800.0, 'created_time': 1768504021.827582, 'last_price_update_time': 1769627137.195231}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118532216') HTTP/1.1" 204 0
2026-01-28 19:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1996f50d-0e91-5bbe-8983-f97edee3ff9a with identifier: 118654382
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1996f50d-0e91-5bbe-8983-f97edee3ff9a with identifier: 118654382
2026-01-28 19:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1996f50d-0e91-5bbe-8983-f97edee3ff9a with identifier: 118654382 to the API
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271996f50d-0e91-5bbe-8983-f97edee3ff9a%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1996f50d-0e91-5bbe-8983-f97edee3ff9a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118654382?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1996f50d-0e91-5bbe-8983-f97edee3ff9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DV22NYP',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118654382',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 13070,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118654382%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [astonbarclay.gb] INFO: Saving data for 118654382: {'created_time': 1769454213.733017, 'last_price_update_time': 1769627137.484514, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118654382') HTTP/1.1" 204 0
2026-01-28 19:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with identifier: 118963908
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with identifier: 118963908
2026-01-28 19:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0a977919-2785-5fdc-9aeb-2984b52bcfd5 with identifier: 118963908 to the API
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270a977919-2785-5fdc-9aeb-2984b52bcfd5%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0a977919-2785-5fdc-9aeb-2984b52bcfd5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118963908?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0a977919-2785-5fdc-9aeb-2984b52bcfd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FY70VPK',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118963908',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'KIA',
'model': 'CEED DIESEL HATCHBACK',
'odometer': 24325,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-07',
'seller_name': 'Mobilize Financial Services',
'title': 'KIA CEED DIESEL HATCHBACK 1.6 CRDi ISG 2 NAV 5dr',
'transmission': 'manual',
'trim': '1.6 CRDi ISG 2 NAV 5dr',
'vin': None,
'year': 2021}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118963908%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [astonbarclay.gb] INFO: Saving data for 118963908: {'created_time': 1769418060.43043, 'last_price_update_time': 1769627137.775973, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118963908') HTTP/1.1" 204 0
2026-01-28 19:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ecafd03c-a95b-5f96-9738-079ad9e4ade1 with identifier: 118641866
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ecafd03c-a95b-5f96-9738-079ad9e4ade1 with identifier: 118641866
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172471 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172471
2026-01-28 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ecafd03c-a95b-5f96-9738-079ad9e4ade1 spider: astonbarclay.gb
2026-01-28 19:05:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ecafd03c-a95b-5f96-9738-079ad9e4ade1 due to rule: high_mileage_for_country.json, error: 172471 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172471
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'RED',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ecafd03c-a95b-5f96-9738-079ad9e4ade1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AY68YKV',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118641866',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'RENAULT',
'model': 'KADJAR HATCHBACK',
'odometer': 107169,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-22',
'seller_name': 'MotoNovo Finance',
'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE Dynamique S Nav 5dr',
'transmission': 'manual',
'trim': '1.3 TCE Dynamique S Nav 5dr',
'vin': None,
'year': 2018}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118641866%27 HTTP/1.1" 200 None
2026-01-28 19:05:37 [astonbarclay.gb] INFO: Saving data for 118641866: {'auction_closing_time': 1769680800.0, 'created_time': 1768503752.268474, 'last_price_update_time': 1769627137.989065}
2026-01-28 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118641866') HTTP/1.1" 204 0
2026-01-28 19:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 220e0619-4660-5b87-a5f0-427f38f2a6c1 with identifier: 117888562
2026-01-28 19:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 220e0619-4660-5b87-a5f0-427f38f2a6c1 with identifier: 117888562
2026-01-28 19:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 220e0619-4660-5b87-a5f0-427f38f2a6c1 with identifier: 117888562 to the API
2026-01-28 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117888562?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '220e0619-4660-5b87-a5f0-427f38f2a6c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GF72BLZ',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117888562',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 40291,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photo_urls': ['https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/cc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg?w=600',
'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg?w=600'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23916,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/7dfcf95a-7513-4a43-8a85-61c3043daea8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27402,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/cc5fdf71-4bf0-4ed2-856a-5d430bc89579_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26152,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/39a97346-00fe-47f9-b17a-50bedf9b4486_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24937,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a5705990-ec3c-4bf9-8b29-3ed59e263e31_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45403,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/693b4cfa-8cbd-4c41-836d-ab237d37eb57_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39658,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/a8192def-1ef2-4b8f-9cac-a5f6af7011ee_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41163,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/35e0ca4f-b675-4dcb-b820-31404abb9c49_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e0619-4660-5b87-a5f0-427f38f2a6c1/220e0619-4660-5b87-a5f0-427f38f2a6c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45157,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/GF72BLZ/2025-12-16/image/58e8c77b-f749-43c9-bb4d-656493681b8c_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-29',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Tekna 5dr',
'transmission': 'manual',
'trim': '1.3 DiG-T MH Tekna 5dr',
'vin': None,
'year': 2022}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117888562%27 HTTP/1.1" 200 None
2026-01-28 19:05:39 [astonbarclay.gb] INFO: Saving data for 117888562: {'created_time': 1769627139.21926, 'last_price_update_time': 1769627139.219269, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117888562') HTTP/1.1" 204 0
2026-01-28 19:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20cddb2e-c221-502e-bbf8-cefb318653fc with identifier: 118974415
2026-01-28 19:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20cddb2e-c221-502e-bbf8-cefb318653fc with identifier: 118974415
2026-01-28 19:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 20cddb2e-c221-502e-bbf8-cefb318653fc with identifier: 118974415 to the API
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2720cddb2e-c221-502e-bbf8-cefb318653fc%27 HTTP/1.1" 200 None
2026-01-28 19:05:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 20cddb2e-c221-502e-bbf8-cefb318653fc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118974415?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '20cddb2e-c221-502e-bbf8-cefb318653fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'FX72YJL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118974415',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'MICRA HATCHBACK',
'odometer': 10374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-30',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN MICRA HATCHBACK 1.0 IG-T 92 Acenta 5dr CVT',
'transmission': 'automatic',
'trim': '1.0 IG-T 92 Acenta 5dr CVT',
'vin': None,
'year': 2022}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118974415%27 HTTP/1.1" 200 None
2026-01-28 19:05:39 [astonbarclay.gb] INFO: Saving data for 118974415: {'created_time': 1769454231.965411, 'last_price_update_time': 1769627139.512803, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118974415') HTTP/1.1" 204 0
2026-01-28 19:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f57366c8-a516-5032-b66f-9e9a4244f4b2 with identifier: 117708882
2026-01-28 19:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f57366c8-a516-5032-b66f-9e9a4244f4b2 with identifier: 117708882
2026-01-28 19:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto [110kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 53856, 'odometer_reading_unit': 'mi', 'registration_date': '2022-05-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708882', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto [110kw ch]', 'license_plate': 're22fbn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f57366c8-a516-5032-b66f-9e9a4244f4b2', 'current_year_diff': 4, 'age_in_months': 44, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 86672} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 44,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'f57366c8-a516-5032-b66f-9e9a4244f4b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 're22fbn',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708882',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 53856,
'odometer_in_km': 86672,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'sanitized_make': 'volkswagen',
'seller_name': 'kinto',
'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto '
'[110kw ch]',
'transmission': 'automatic',
'trim': '109kw life pure 52kwh 5dr auto [110kw ch]',
'vin': None,
'year': 2022}
2026-01-28 19:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f57366c8-a516-5032-b66f-9e9a4244f4b2 spider: astonbarclay.gb
2026-01-28 19:05:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f57366c8-a516-5032-b66f-9e9a4244f4b2 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto [110kw ch]', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 53856, 'odometer_reading_unit': 'mi', 'registration_date': '2022-05-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708882', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto [110kw ch]', 'license_plate': 're22fbn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f57366c8-a516-5032-b66f-9e9a4244f4b2', 'current_year_diff': 4, 'age_in_months': 44, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 86672} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 44,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'black',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'f57366c8-a516-5032-b66f-9e9a4244f4b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 're22fbn',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708882',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volkswagen',
'make_model': 'volkswagen id.4 estate',
'model': 'id.4 estate',
'odometer': 53856,
'odometer_in_km': 86672,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'sanitized_make': 'volkswagen',
'seller_name': 'kinto',
'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto '
'[110kw ch]',
'transmission': 'automatic',
'trim': '109kw life pure 52kwh 5dr auto [110kw ch]',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'f57366c8-a516-5032-b66f-9e9a4244f4b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RE22FBN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708882',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLKSWAGEN',
'model': 'ID.4 ESTATE',
'odometer': 53856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'seller_name': 'Kinto',
'title': 'VOLKSWAGEN ID.4 ESTATE 109kW Life Pure 52kWh 5dr Auto [110kW Ch]',
'transmission': 'automatic',
'trim': '109kW Life Pure 52kWh 5dr Auto [110kW Ch]',
'vin': None,
'year': 2022}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708882%27 HTTP/1.1" 200 None
2026-01-28 19:05:39 [astonbarclay.gb] INFO: Saving data for 117708882: {'auction_closing_time': 1769680800.0, 'created_time': 1767986510.019249, 'last_price_update_time': 1769627139.728129}
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117708882') HTTP/1.1" 204 0
2026-01-28 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fa81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190532490>
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190472710>
2026-01-28 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19FYN%252F2026-01-28%252Fimage%252Fbb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e50a3d0e-5890-5138-b37c-8900e2043e96
2026-01-28 19:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e50a3d0e-5890-5138-b37c-8900e2043e96, skipping ID generation
2026-01-28 19:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50a3d0e-5890-5138-b37c-8900e2043e96 with scrape type 1
2026-01-28 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e50a3d0e-5890-5138-b37c-8900e2043e96 from tracking dictionaries
2026-01-28 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e50a3d0e-5890-5138-b37c-8900e2043e96 sending to next pipeline
2026-01-28 19:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e50a3d0e-5890-5138-b37c-8900e2043e96, identifier: 119052700
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e50a3d0e-5890-5138-b37c-8900e2043e96 with identifier: 119052700
2026-01-28 19:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e50a3d0e-5890-5138-b37c-8900e2043e96 with identifier: 119052700
2026-01-28 19:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130858 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130858
2026-01-28 19:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e50a3d0e-5890-5138-b37c-8900e2043e96 spider: astonbarclay.gb
2026-01-28 19:05:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e50a3d0e-5890-5138-b37c-8900e2043e96 due to rule: high_mileage_for_make.json, error: 130858 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130858
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'SILVER',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Diesel',
'id': 'e50a3d0e-5890-5138-b37c-8900e2043e96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'AX19FYN',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119052700',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
'odometer': 81312,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32569,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/9fd518f7-904f-4177-ae17-3c45d3906180_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32671,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/43ccb01e-a949-4e95-9227-b76f844e0bab_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31078,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/046ed90b-3baf-4867-a1d8-bda37dde147d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30800,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/75799fed-5c5c-4526-9477-587ec0bd44c2_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34484,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/334d357d-24d2-429c-9120-bc1f8c853934_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52061,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b5ac514b-4785-472d-8698-9439d862ea9f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48314,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/85efdbea-2afa-4960-8690-607c8e31216d_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44666,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/b4c29a32-6b44-4e03-880d-14eb0295598a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50a3d0e-5890-5138-b37c-8900e2043e96/e50a3d0e-5890-5138-b37c-8900e2043e96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46555,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/AX19FYN/2026-01-28/image/bb09d713-4cfe-486f-908c-46ef9af4c80e_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': 'UKCGR - Premium',
'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 D180 R-Dynamic '
'SE 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 D180 R-Dynamic SE 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119052700%27 HTTP/1.1" 200 None
2026-01-28 19:05:40 [astonbarclay.gb] INFO: Saving data for 119052700: {'created_time': 1769627140.558846, 'last_price_update_time': 1769627140.558857, 'auction_closing_time': 1769766300.0}
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119052700') HTTP/1.1" 204 0
2026-01-28 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190212bd0>
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318377d9d0>
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190471150>
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374c5d0>
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fd3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/119055092?view=catalogue)
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319032d650>
2026-01-28 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252Fa81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118052235?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118724241?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118135535?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118724278?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319023bbd0>
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYW19TZS%252F2026-01-28%252Fimage%252F1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99
2026-01-28 19:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f9d4936-a8f7-54cc-803c-a5cadff2be99, skipping ID generation
2026-01-28 19:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with scrape type 1
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3f9d4936-a8f7-54cc-803c-a5cadff2be99 from tracking dictionaries
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f9d4936-a8f7-54cc-803c-a5cadff2be99 sending to next pipeline
2026-01-28 19:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3f9d4936-a8f7-54cc-803c-a5cadff2be99, identifier: 119055092
2026-01-28 19:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with identifier: 119055092
2026-01-28 19:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with identifier: 119055092
2026-01-28 19:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3f9d4936-a8f7-54cc-803c-a5cadff2be99 with identifier: 119055092 to the API
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'expiration_date': '2026-01-30T09:45:00Z',
'fuel_type': 'Petrol',
'id': '3f9d4936-a8f7-54cc-803c-a5cadff2be99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'YW19TZS',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/119055092',
'listing': 'auction',
'location': 'Aston Barclay Wakefield',
'make': 'MG MOTOR UK',
'model': 'ZS HATCHBACK SPECIAL EDITION',
'odometer': 46204,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24147,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/0c625937-a1c9-4b93-ac5b-5ab0f97f70b8_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23627,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/8df54ba6-3418-4530-aad9-dadfab358398_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20085,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/36560e3d-50cd-4950-9398-c378a3eedefa_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21574,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d644e8ce-9195-4649-9b60-1aa3efd1f556_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41710,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/97f5eb9a-fb01-4d1d-9dd1-1a170187ac93_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52981,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d020adaf-fbf8-4772-b016-b46e7ba9ec2c_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42850,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/12dc3c3e-e229-4e60-931f-a8fb7805cbcc_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33600,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/d3c54d2c-7efe-4963-9759-7d99a79e0f4e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50823,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/a81e1ca6-9754-4603-8ca2-709d0e3935c1_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9d4936-a8f7-54cc-803c-a5cadff2be99/3f9d4936-a8f7-54cc-803c-a5cadff2be99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 15978,
'Height': 375,
'OriginUrl': 'https://abimg003.imgix.net/YW19TZS/2026-01-28/image/1d7102af-c7a5-4853-a1a6-32becea9ec72_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-21',
'seller_name': 'UKCGR - Premium',
'title': 'MG MOTOR UK ZS HATCHBACK SPECIAL EDITION 1.5 VTi-TECH Limited '
'Edition 5dr',
'transmission': 'manual',
'trim': '1.5 VTi-TECH Limited Edition 5dr',
'vin': None,
'year': 2019}
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27119055092%27 HTTP/1.1" 200 None
2026-01-28 19:05:42 [astonbarclay.gb] INFO: Saving data for 119055092: {'created_time': 1769627142.785701, 'last_price_update_time': 1769627142.785711, 'auction_closing_time': 1769766300.0}
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='119055092') HTTP/1.1" 204 0
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118452050?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118811715?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118052235, 'registration': 'WP72FLL', 'account': 'ZEN002', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 3 65kWh 5dr Auto', 'mileage': 25957, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 84, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-31', 'fuel': 'Electric', 'motExpiry': '2026-12-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WP72FLL/2026-01-08/image/e77ab8c5-d280-49aa-9d52-54ec0f07f802_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/127fd036-1d8e-4d3b-814b-13d9a8d60430_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/52f847f5-e7a8-446f-8a27-51062570c867_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/f8d2d954-fa97-40fd-b103-48f5d53ca994_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/18857007-abce-4a8e-9067-38ec4e01dd21_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/18bdfc7c-8763-4373-952a-8f63f2c0a647_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/1f48c1ab-72e4-474f-b686-a4a51f5f56af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/89f57439-5db8-4f22-88d2-fc292cc2cfd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/25-25K', 'remarks': 'VOSA STATES 25K, BLANK BOOK, Heat Pump\tPremium Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82e574b2-46a3-4f40-b29b-9217eef86d70.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118052235, 'registration': 'WP72FLL', 'account': 'ZEN002', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 3 65kWh 5dr Auto', 'mileage': 25957, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 84, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-31', 'fuel': 'Electric', 'motExpiry': '2026-12-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WP72FLL/2026-01-08/image/e77ab8c5-d280-49aa-9d52-54ec0f07f802_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/127fd036-1d8e-4d3b-814b-13d9a8d60430_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/52f847f5-e7a8-446f-8a27-51062570c867_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/f8d2d954-fa97-40fd-b103-48f5d53ca994_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/18857007-abce-4a8e-9067-38ec4e01dd21_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/18bdfc7c-8763-4373-952a-8f63f2c0a647_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/1f48c1ab-72e4-474f-b686-a4a51f5f56af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP72FLL/2026-01-08/image/89f57439-5db8-4f22-88d2-fc292cc2cfd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/25-25K', 'remarks': 'VOSA STATES 25K, BLANK BOOK, Heat Pump\tPremium Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82e574b2-46a3-4f40-b29b-9217eef86d70.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e174ea-232c-5021-a63f-ec4ea1259e60 with identifier: 118052235
2026-01-28 19:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e174ea-232c-5021-a63f-ec4ea1259e60 with scrape type 2
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e174ea-232c-5021-a63f-ec4ea1259e60 with scrape type 2
2026-01-28 19:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0e174ea-232c-5021-a63f-ec4ea1259e60, identifier: 118052235
2026-01-28 19:05:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118724241, 'registration': 'MW67PUE', 'account': 'HAT009', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '3.0 TDI Quattro S Line 5dr Tip Auto', 'mileage': 105476, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 311, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-12-11', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MW67PUE/2026-01-21/image/24810cb2-4c29-4780-a718-dc5f9d964fb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/7bce5d06-99ea-4e23-aec6-9c0280c2df4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/af79aa8d-80e0-408d-acc5-711a5de2d30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/f2fb18ce-b6bc-4b00-835e-2500ccf02931_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/7aad72ac-3d67-4144-a9bf-e4a7909b57a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/40a59bbb-cc7d-4d85-adcb-61a89b692546_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/14aea85d-9458-4757-b39b-131af33e407b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/1e25163c-878b-41c7-aa96-ad774b072a69_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/09c6f04a-d102-4e83-92c3-a94cec6c853e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/22- 18K, 01/23- 36K, 02/24- 60K, 01/25- 83K, 10/25- 100K,', 'remarks': '**26**VOSA STATES 11K, 11K, 11K, 36K, 60K, 83K, 104K', 'virtual': True, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2623631a-34e5-40e9-b7b7-9e52ccdf1489.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118724241, 'registration': 'MW67PUE', 'account': 'HAT009', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '3.0 TDI Quattro S Line 5dr Tip Auto', 'mileage': 105476, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 311, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-12-11', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MW67PUE/2026-01-21/image/24810cb2-4c29-4780-a718-dc5f9d964fb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/7bce5d06-99ea-4e23-aec6-9c0280c2df4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/af79aa8d-80e0-408d-acc5-711a5de2d30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/f2fb18ce-b6bc-4b00-835e-2500ccf02931_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/7aad72ac-3d67-4144-a9bf-e4a7909b57a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/40a59bbb-cc7d-4d85-adcb-61a89b692546_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/14aea85d-9458-4757-b39b-131af33e407b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/1e25163c-878b-41c7-aa96-ad774b072a69_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW67PUE/2026-01-21/image/09c6f04a-d102-4e83-92c3-a94cec6c853e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/22- 18K, 01/23- 36K, 02/24- 60K, 01/25- 83K, 10/25- 100K,', 'remarks': '**26**VOSA STATES 11K, 11K, 11K, 36K, 60K, 83K, 104K', 'virtual': True, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2623631a-34e5-40e9-b7b7-9e52ccdf1489.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1361fb9d-341e-57b6-8ceb-399b82226045 with identifier: 118724241
2026-01-28 19:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1361fb9d-341e-57b6-8ceb-399b82226045 with scrape type 2
2026-01-28 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1361fb9d-341e-57b6-8ceb-399b82226045 with scrape type 2
2026-01-28 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1361fb9d-341e-57b6-8ceb-399b82226045, identifier: 118724241
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118135535, 'registration': 'YK25RTX', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 8402, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 25, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK25RTX/2025-12-19/image/4703af8d-ce65-4e6d-8546-2d7ebbebacf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/9e526f51-4254-47f3-8050-706226e8b178_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/6526b19d-dc83-4479-8bef-1623eb013a2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/afd2d939-4dc1-4876-81b8-d66a67334fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/a1983624-bd64-4744-bb0b-e4254b5790d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/90f3f6bd-7c16-4492-b047-1f90d4c609f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/ba9be15e-53f6-42c8-bf60-7b149a726af0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/df96d77d-60e4-429f-8267-3ce8ed33d580_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff893748-4558-4771-b064-ecb5720a0ea1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118135535, 'registration': 'YK25RTX', 'account': 'REG024', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Design 5dr CVT', 'mileage': 8402, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 25, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK25RTX/2025-12-19/image/4703af8d-ce65-4e6d-8546-2d7ebbebacf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/9e526f51-4254-47f3-8050-706226e8b178_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/6526b19d-dc83-4479-8bef-1623eb013a2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/afd2d939-4dc1-4876-81b8-d66a67334fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/a1983624-bd64-4744-bb0b-e4254b5790d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/90f3f6bd-7c16-4492-b047-1f90d4c609f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/ba9be15e-53f6-42c8-bf60-7b149a726af0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK25RTX/2025-12-19/image/df96d77d-60e4-429f-8267-3ce8ed33d580_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 12, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff893748-4558-4771-b064-ecb5720a0ea1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a5541d-4beb-5ccb-9228-c5047f9ef478 with identifier: 118135535
2026-01-28 19:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a5541d-4beb-5ccb-9228-c5047f9ef478 with scrape type 2
2026-01-28 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05a5541d-4beb-5ccb-9228-c5047f9ef478 with scrape type 2
2026-01-28 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05a5541d-4beb-5ccb-9228-c5047f9ef478, identifier: 118135535
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118724278, 'registration': 'BJ67PZB', 'account': 'HAT009', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '1.4T FSI S Line Edition 5dr S Tronic', 'mileage': 97347, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 310, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-01-26', 'fuel': 'Petrol', 'motExpiry': '2026-02-02', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/b69cae0e-7828-472d-b0b1-b2a006d964c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/87e6fa81-9ea7-4807-9f5c-5aa256b8ee56_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/a57623f2-ac1c-448f-921c-7feed974e551_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/44d3b7c4-42d5-4f0a-a5b8-54304b423bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/6459ee5a-d89e-4966-a010-1f200d39e644_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/a0e57617-7e70-4ffa-b720-3dab827b9919_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/124cce9c-c8da-4f50-b0d8-2609bde82507_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/42988df4-8da2-44c7-b063-bf47ca095b8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/d9b05e28-0f15-4345-a004-e5eb3cdcf958_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/19 - 17K, 11/21 - 34K, 09/23 - 59K, 03/24 - 70K,', 'remarks': '**65** VOSA STATES 29K, 38K, 50K, 66K, 82K, SD CARD', 'virtual': True, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cacaf17d-ba41-48dd-bdbb-badaab23f5e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118724278, 'registration': 'BJ67PZB', 'account': 'HAT009', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '1.4T FSI S Line Edition 5dr S Tronic', 'mileage': 97347, 'mileageWarranty': True, 'type': 'car', 'saleId': 18058, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 114}, 'saleStart': '2026-01-29T10:00Z', 'lot': 310, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-01-26', 'fuel': 'Petrol', 'motExpiry': '2026-02-02', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/b69cae0e-7828-472d-b0b1-b2a006d964c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/87e6fa81-9ea7-4807-9f5c-5aa256b8ee56_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/a57623f2-ac1c-448f-921c-7feed974e551_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/44d3b7c4-42d5-4f0a-a5b8-54304b423bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/6459ee5a-d89e-4966-a010-1f200d39e644_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/a0e57617-7e70-4ffa-b720-3dab827b9919_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/124cce9c-c8da-4f50-b0d8-2609bde82507_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/42988df4-8da2-44c7-b063-bf47ca095b8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ67PZB/2026-01-27/image/d9b05e28-0f15-4345-a004-e5eb3cdcf958_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/19 - 17K, 11/21 - 34K, 09/23 - 59K, 03/24 - 70K,', 'remarks': '**65** VOSA STATES 29K, 38K, 50K, 66K, 82K, SD CARD', 'virtual': True, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cacaf17d-ba41-48dd-bdbb-badaab23f5e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b618a255-c395-53ee-8944-0025867d7b88 with identifier: 118724278
2026-01-28 19:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b618a255-c395-53ee-8944-0025867d7b88 with scrape type 2
2026-01-28 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b618a255-c395-53ee-8944-0025867d7b88 with scrape type 2
2026-01-28 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b618a255-c395-53ee-8944-0025867d7b88, identifier: 118724278
2026-01-28 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0e174ea-232c-5021-a63f-ec4ea1259e60 with identifier: 118052235
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0e174ea-232c-5021-a63f-ec4ea1259e60 with identifier: 118052235
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 3 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 25957, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118052235', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 3 65kwh 5dr auto', 'license_plate': 'wp72fll', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b0e174ea-232c-5021-a63f-ec4ea1259e60', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 41773} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'b0e174ea-232c-5021-a63f-ec4ea1259e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'wp72fll',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118052235',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'kia',
'make_model': 'kia niro ev estate',
'model': 'niro ev estate',
'odometer': 25957,
'odometer_in_km': 41773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'sanitized_make': 'kia',
'seller_name': 'zenith',
'title': 'kia niro ev estate 150kw 3 65kwh 5dr auto',
'transmission': 'automatic',
'trim': '150kw 3 65kwh 5dr auto',
'vin': None,
'year': 2022}
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b0e174ea-232c-5021-a63f-ec4ea1259e60 spider: astonbarclay.gb
2026-01-28 19:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b0e174ea-232c-5021-a63f-ec4ea1259e60 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 3 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 25957, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118052235', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 3 65kwh 5dr auto', 'license_plate': 'wp72fll', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b0e174ea-232c-5021-a63f-ec4ea1259e60', 'current_year_diff': 4, 'age_in_months': 36, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 41773} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': 'b0e174ea-232c-5021-a63f-ec4ea1259e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'wp72fll',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118052235',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'kia',
'make_model': 'kia niro ev estate',
'model': 'niro ev estate',
'odometer': 25957,
'odometer_in_km': 41773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'sanitized_make': 'kia',
'seller_name': 'zenith',
'title': 'kia niro ev estate 150kw 3 65kwh 5dr auto',
'transmission': 'automatic',
'trim': '150kw 3 65kwh 5dr auto',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'b0e174ea-232c-5021-a63f-ec4ea1259e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WP72FLL',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118052235',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'KIA',
'model': 'NIRO EV ESTATE',
'odometer': 25957,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-31',
'seller_name': 'Zenith',
'title': 'KIA NIRO EV ESTATE 150kW 3 65kWh 5dr Auto',
'transmission': 'automatic',
'trim': '150kW 3 65kWh 5dr Auto',
'vin': None,
'year': 2022}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118052235%27 HTTP/1.1" 200 None
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Saving data for 118052235: {'auction_closing_time': 1769680800.0, 'created_time': 1768936773.131948, 'last_price_update_time': 1769627143.429456}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118052235') HTTP/1.1" 204 0
2026-01-28 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1361fb9d-341e-57b6-8ceb-399b82226045 with identifier: 118724241
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1361fb9d-341e-57b6-8ceb-399b82226045 with identifier: 118724241
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169746 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169746
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1361fb9d-341e-57b6-8ceb-399b82226045 spider: astonbarclay.gb
2026-01-28 19:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1361fb9d-341e-57b6-8ceb-399b82226045 due to rule: high_mileage_for_country.json, error: 169746 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169746
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1361fb9d-341e-57b6-8ceb-399b82226045',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'MW67PUE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724241',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'AUDI',
'model': 'Q7 DIESEL ESTATE',
'odometer': 105476,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-21',
'seller_name': 'Hatfields Group',
'title': 'AUDI Q7 DIESEL ESTATE 3.0 TDI Quattro S Line 5dr Tip Auto',
'transmission': 'automatic',
'trim': '3.0 TDI Quattro S Line 5dr Tip Auto',
'vin': None,
'year': 2017}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724241%27 HTTP/1.1" 200 None
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Saving data for 118724241: {'auction_closing_time': 1769680800.0, 'created_time': 1768849422.114164, 'last_price_update_time': 1769627143.639878}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118724241') HTTP/1.1" 204 0
2026-01-28 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05a5541d-4beb-5ccb-9228-c5047f9ef478 with identifier: 118135535
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05a5541d-4beb-5ccb-9228-c5047f9ef478 with identifier: 118135535
2026-01-28 19:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 05a5541d-4beb-5ccb-9228-c5047f9ef478 with identifier: 118135535 to the API
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118135535?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 12,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '05a5541d-4beb-5ccb-9228-c5047f9ef478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YK25RTX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118135535',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TOYOTA',
'model': 'PRIUS HATCHBACK',
'odometer': 8402,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-28',
'seller_name': 'Regulus Asset Management',
'title': 'TOYOTA PRIUS HATCHBACK 2.0 PHEV Design 5dr CVT',
'transmission': 'automatic',
'trim': '2.0 PHEV Design 5dr CVT',
'vin': None,
'year': 2025}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118135535%27 HTTP/1.1" 200 None
2026-01-28 19:05:43 [astonbarclay.gb] INFO: Saving data for 118135535: {'auction_closing_time': 1769680800.0, 'created_time': 1767986547.174998, 'last_price_update_time': 1769627143.939332}
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118135535') HTTP/1.1" 204 0
2026-01-28 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b618a255-c395-53ee-8944-0025867d7b88 with identifier: 118724278
2026-01-28 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b618a255-c395-53ee-8944-0025867d7b88 with identifier: 118724278
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156664 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156664
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b618a255-c395-53ee-8944-0025867d7b88 spider: astonbarclay.gb
2026-01-28 19:05:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b618a255-c395-53ee-8944-0025867d7b88 due to rule: high_mileage_for_country.json, error: 156664 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156664
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b618a255-c395-53ee-8944-0025867d7b88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'BJ67PZB',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118724278',
'listing': 'auction',
'location': 'Aston Barclay Prees Heath',
'make': 'AUDI',
'model': 'Q3 ESTATE SPECIAL EDITIONS',
'odometer': 97347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-26',
'seller_name': 'Hatfields Group',
'title': 'AUDI Q3 ESTATE SPECIAL EDITIONS 1.4T FSI S Line Edition 5dr S '
'Tronic',
'transmission': 'automatic',
'trim': '1.4T FSI S Line Edition 5dr S Tronic',
'vin': None,
'year': 2018}
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118724278%27 HTTP/1.1" 200 None
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Saving data for 118724278: {'auction_closing_time': 1769680800.0, 'created_time': 1768849406.511918, 'last_price_update_time': 1769627144.186709}
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118724278') HTTP/1.1" 204 0
2026-01-28 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118982822?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118452050, 'registration': 'YR25MKA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'EX30 ESTATE', 'derivative': '200kW SM Extended Range Plus 69kWh 5dr Auto', 'mileage': 5866, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 71, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR25MKA/2026-01-13/image/cc76c6e3-fa6a-4458-b0a5-235b0bd19ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/a6ae8f21-a40b-4bfe-8f80-250c4b4e3fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/50b8241e-892b-4f45-b9bf-1b34ef31b101_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/b1dba1f8-c281-48ca-ae96-de30cdb8e643_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/44521cb8-b991-4e9c-a2b2-c796adaf61a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/a08f2175-a43c-4985-8fe0-1a9628c7bbdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/bce5da01-6f94-470b-a0ff-e6b687056b80_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/14e78ada-1c78-4aad-a6a8-66858c393acf_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f8e6c58-19c8-47cf-8b1b-09a2f06b9a52.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118452050, 'registration': 'YR25MKA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'EX30 ESTATE', 'derivative': '200kW SM Extended Range Plus 69kWh 5dr Auto', 'mileage': 5866, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 71, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR25MKA/2026-01-13/image/cc76c6e3-fa6a-4458-b0a5-235b0bd19ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/a6ae8f21-a40b-4bfe-8f80-250c4b4e3fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/50b8241e-892b-4f45-b9bf-1b34ef31b101_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/b1dba1f8-c281-48ca-ae96-de30cdb8e643_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/44521cb8-b991-4e9c-a2b2-c796adaf61a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/a08f2175-a43c-4985-8fe0-1a9628c7bbdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/bce5da01-6f94-470b-a0ff-e6b687056b80_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR25MKA/2026-01-13/image/14e78ada-1c78-4aad-a6a8-66858c393acf_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f8e6c58-19c8-47cf-8b1b-09a2f06b9a52.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b999f0b-c544-52fd-9bf8-f2146e488a71 with identifier: 118452050
2026-01-28 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b999f0b-c544-52fd-9bf8-f2146e488a71 with scrape type 2
2026-01-28 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b999f0b-c544-52fd-9bf8-f2146e488a71 with scrape type 2
2026-01-28 19:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0b999f0b-c544-52fd-9bf8-f2146e488a71, identifier: 118452050
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118811715, 'registration': 'OY17OYX', 'account': 'RCI002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Vision 5dr Xtronic', 'mileage': 62675, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 313, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-30', 'fuel': 'Petrol', 'motExpiry': '2025-10-03', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OY17OYX/2026-01-28/image/8651d570-247e-4915-a8dd-de00b5138309_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/6d51b0d9-52d7-43de-8586-e9f41bbf8d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/7e56c491-3c35-43e5-ac24-dae7e2389260_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/4c1fccec-c87a-4662-acdc-f36df7f74df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/f36aea2d-5fea-4195-8024-6c3a56052da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/cb7df8b8-4ad2-4186-aecb-03bf0f7827bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/c313337d-65f9-46a9-9532-aaec8abb55f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/a9c0679d-9c55-4ccf-8d48-fbbb189ccdc8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K 22K 27K 31K 45K 53K', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18704d46-1af0-4180-90df-ea1047032f74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118811715, 'registration': 'OY17OYX', 'account': 'RCI002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Vision 5dr Xtronic', 'mileage': 62675, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 313, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-30', 'fuel': 'Petrol', 'motExpiry': '2025-10-03', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OY17OYX/2026-01-28/image/8651d570-247e-4915-a8dd-de00b5138309_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/6d51b0d9-52d7-43de-8586-e9f41bbf8d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/7e56c491-3c35-43e5-ac24-dae7e2389260_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/4c1fccec-c87a-4662-acdc-f36df7f74df1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/f36aea2d-5fea-4195-8024-6c3a56052da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/cb7df8b8-4ad2-4186-aecb-03bf0f7827bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/c313337d-65f9-46a9-9532-aaec8abb55f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY17OYX/2026-01-28/image/a9c0679d-9c55-4ccf-8d48-fbbb189ccdc8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K 22K 27K 31K 45K 53K', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18704d46-1af0-4180-90df-ea1047032f74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2026-01-28 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with identifier: 118811715
2026-01-28 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with scrape type 2
2026-01-28 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with scrape type 2
2026-01-28 19:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4c59fdec-7973-5b74-a4f8-b3f014e72dbe, identifier: 118811715
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118838708, 'registration': 'GY74OLW', 'account': 'ZEN002', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Excel 5dr CVT', 'mileage': 8379, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 184, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 17, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4e406b37-4d8e-49f8-a1da-449327352014.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118838708, 'registration': 'GY74OLW', 'account': 'ZEN002', 'make': 'TOYOTA', 'model': 'PRIUS HATCHBACK', 'derivative': '2.0 PHEV Excel 5dr CVT', 'mileage': 8379, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 184, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 17, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4e406b37-4d8e-49f8-a1da-449327352014.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with identifier: 118838708
2026-01-28 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with scrape type 1
2026-01-28 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0b999f0b-c544-52fd-9bf8-f2146e488a71 with identifier: 118452050
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0b999f0b-c544-52fd-9bf8-f2146e488a71 with identifier: 118452050
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volvo ex30 estate 200kw sm extended range plus 69kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'ex30 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 5866, 'odometer_reading_unit': 'mi', 'registration_date': '2025-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118452050', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '200kw sm extended range plus 69kwh 5dr auto', 'license_plate': 'yr25mka', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0b999f0b-c544-52fd-9bf8-f2146e488a71', 'current_year_diff': 1, 'age_in_months': 9, 'make_model': 'volvo ex30 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 9440} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 9,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'yellow',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '0b999f0b-c544-52fd-9bf8-f2146e488a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yr25mka',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118452050',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volvo',
'make_model': 'volvo ex30 estate',
'model': 'ex30 estate',
'odometer': 5866,
'odometer_in_km': 9440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-29',
'sanitized_make': 'volvo',
'seller_name': 'zenith',
'title': 'volvo ex30 estate 200kw sm extended range plus 69kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '200kw sm extended range plus 69kwh 5dr auto',
'vin': None,
'year': 2025}
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0b999f0b-c544-52fd-9bf8-f2146e488a71 spider: astonbarclay.gb
2026-01-28 19:05:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0b999f0b-c544-52fd-9bf8-f2146e488a71 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volvo ex30 estate 200kw sm extended range plus 69kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'ex30 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 5866, 'odometer_reading_unit': 'mi', 'registration_date': '2025-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118452050', 'expiration_date': '2026-01-29t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '200kw sm extended range plus 69kwh 5dr auto', 'license_plate': 'yr25mka', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0b999f0b-c544-52fd-9bf8-f2146e488a71', 'current_year_diff': 1, 'age_in_months': 9, 'make_model': 'volvo ex30 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 9440} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 9,
'auction_title': '',
'c_o_2_emission_value': None,
'color': 'yellow',
'currency': 'gbp',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '',
'expiration_date': '2026-01-29t10:00:00z',
'fuel_type': 'electric',
'id': '0b999f0b-c544-52fd-9bf8-f2146e488a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'yr25mka',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118452050',
'listing': 'auction',
'location': 'aston barclay donington park',
'make': 'volvo',
'make_model': 'volvo ex30 estate',
'model': 'ex30 estate',
'odometer': 5866,
'odometer_in_km': 9440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-29',
'sanitized_make': 'volvo',
'seller_name': 'zenith',
'title': 'volvo ex30 estate 200kw sm extended range plus 69kwh 5dr '
'auto',
'transmission': 'automatic',
'trim': '200kw sm extended range plus 69kwh 5dr auto',
'vin': None,
'year': 2025}
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'YELLOW',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Electric',
'id': '0b999f0b-c544-52fd-9bf8-f2146e488a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YR25MKA',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118452050',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'VOLVO',
'model': 'EX30 ESTATE',
'odometer': 5866,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-29',
'seller_name': 'Zenith',
'title': 'VOLVO EX30 ESTATE 200kW SM Extended Range Plus 69kWh 5dr Auto',
'transmission': 'automatic',
'trim': '200kW SM Extended Range Plus 69kWh 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118452050%27 HTTP/1.1" 200 None
2026-01-28 19:05:44 [astonbarclay.gb] INFO: Saving data for 118452050: {'auction_closing_time': 1769680800.0, 'created_time': 1768294850.397379, 'last_price_update_time': 1769627144.729625}
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118452050') HTTP/1.1" 204 0
2026-01-28 19:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with identifier: 118811715
2026-01-28 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with identifier: 118811715
2026-01-28 19:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4c59fdec-7973-5b74-a4f8-b3f014e72dbe with identifier: 118811715 to the API
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274c59fdec-7973-5b74-a4f8-b3f014e72dbe%27 HTTP/1.1" 200 None
2026-01-28 19:05:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4c59fdec-7973-5b74-a4f8-b3f014e72dbe: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118811715?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'WHITE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4c59fdec-7973-5b74-a4f8-b3f014e72dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': 'OY17OYX',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118811715',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'QASHQAI HATCHBACK',
'odometer': 62675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': 'Mobilize Financial Services',
'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Vision 5dr Xtronic',
'transmission': 'automatic',
'trim': '1.2 DiG-T N-Vision 5dr Xtronic',
'vin': None,
'year': 2017}
2026-01-28 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118811715%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Saving data for 118811715: {'created_time': 1769195068.550493, 'last_price_update_time': 1769627145.004474, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118811715') HTTP/1.1" 204 0
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116931547?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Ff1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118982822, 'registration': 'DS68ZKO', 'account': 'RCI001', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 Landmark 5dr Auto', 'mileage': 69321, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 308, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-08', 'fuel': 'Diesel', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/967da868-3b8a-4035-aa99-e89eddb25ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/11cc6498-54fc-4745-866e-4355a364c8a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/883ba855-8b4a-4e0d-8a7e-7a3514d6b2c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/f02b5766-f6a1-4637-a0d4-8573b123d7b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/f0997cba-148d-4e04-9b09-7e4ce911ccc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/fba3e8cc-6616-4efd-b73d-e1a4f8636995_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/7d099d1e-5be5-408d-86fa-fd8d1fd5ec80_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/100490dd-0483-42f5-87b2-6f4626b11496_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/b70a9236-6830-4ee4-b28a-236f5abb92c8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/20-19k,', 'remarks': 'VOSA STATES 25K 36K 46K 59K, spare key', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d6c49c13-e6ad-4e6f-a672-712e418b5e48.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118982822, 'registration': 'DS68ZKO', 'account': 'RCI001', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 Landmark 5dr Auto', 'mileage': 69321, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 308, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-08', 'fuel': 'Diesel', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/967da868-3b8a-4035-aa99-e89eddb25ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/11cc6498-54fc-4745-866e-4355a364c8a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/883ba855-8b4a-4e0d-8a7e-7a3514d6b2c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/f02b5766-f6a1-4637-a0d4-8573b123d7b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/f0997cba-148d-4e04-9b09-7e4ce911ccc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/fba3e8cc-6616-4efd-b73d-e1a4f8636995_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/7d099d1e-5be5-408d-86fa-fd8d1fd5ec80_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/100490dd-0483-42f5-87b2-6f4626b11496_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS68ZKO/2026-01-28/image/b70a9236-6830-4ee4-b28a-236f5abb92c8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/20-19k,', 'remarks': 'VOSA STATES 25K 36K 46K 59K, spare key', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d6c49c13-e6ad-4e6f-a672-712e418b5e48.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with identifier: 118982822
2026-01-28 19:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with scrape type 2
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with scrape type 2
2026-01-28 19:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b916c2a1-95b7-5b68-a61e-3ee12fa3b986, identifier: 118982822
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with identifier: 118982822
2026-01-28 19:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with identifier: 118982822
2026-01-28 19:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b916c2a1-95b7-5b68-a61e-3ee12fa3b986 with identifier: 118982822 to the API
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b916c2a1-95b7-5b68-a61e-3ee12fa3b986%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b916c2a1-95b7-5b68-a61e-3ee12fa3b986: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 19:05:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-01-28 19:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/118982822?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 170,
'color': 'BLACK',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b916c2a1-95b7-5b68-a61e-3ee12fa3b986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DS68ZKO',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118982822',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT DIESEL SW',
'odometer': 69321,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-08',
'seller_name': 'Mobilize Financial Services',
'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 Landmark 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 TD4 180 Landmark 5dr Auto',
'vin': None,
'year': 2019}
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118982822%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Saving data for 118982822: {'created_time': 1769454219.09915, 'last_price_update_time': 1769627145.459717, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118982822') HTTP/1.1" 204 0
2026-01-28 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 118333789, 'registration': 'YH25CKE', 'account': 'LIQ001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T Acenta Premium 5dr', 'mileage': 18342, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 19, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-03-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/25-17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/46f516fc-bcfc-415d-bd90-e3dee7335de7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 118333789, 'registration': 'YH25CKE', 'account': 'LIQ001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T Acenta Premium 5dr', 'mileage': 18342, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 19, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-03-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/25-17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/46f516fc-bcfc-415d-bd90-e3dee7335de7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with identifier: 118333789
2026-01-28 19:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with scrape type 1
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116931547, 'registration': 'RO25DUH', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19983, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 20, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/41f20fcd-c1ad-4836-941f-bf70889295ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/584ec2b0-a283-44c7-bdc8-3406c4c035f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/7076ad4b-2ed5-4f07-a2f7-02eb4d75ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2df89cc5-cad5-4aea-88d1-8c1398526806_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/d5cc8513-e663-4195-8295-ac5bef708bc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/05617eb8-3fca-4c78-8101-399b9f659628_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/f95e8026-01c9-4bbd-b819-e6cd856e0115_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2e0ab0c2-cae9-423e-bc0d-d7e6257a1ed4_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce4e9eea-9384-4455-afa6-da13fba90bb9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116931547, 'registration': 'RO25DUH', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19983, 'mileageWarranty': True, 'type': 'car', 'saleId': 18360, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 408}, 'saleStart': '2026-01-29T10:00Z', 'lot': 20, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/41f20fcd-c1ad-4836-941f-bf70889295ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/584ec2b0-a283-44c7-bdc8-3406c4c035f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/7076ad4b-2ed5-4f07-a2f7-02eb4d75ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2df89cc5-cad5-4aea-88d1-8c1398526806_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/d5cc8513-e663-4195-8295-ac5bef708bc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/05617eb8-3fca-4c78-8101-399b9f659628_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/f95e8026-01c9-4bbd-b819-e6cd856e0115_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2e0ab0c2-cae9-423e-bc0d-d7e6257a1ed4_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce4e9eea-9384-4455-afa6-da13fba90bb9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2026-01-28 19:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2026-01-28 19:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1553c78-f1c2-570a-880a-7632c09f1c2a with scrape type 2
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1553c78-f1c2-570a-880a-7632c09f1c2a with scrape type 2
2026-01-28 19:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1553c78-f1c2-570a-880a-7632c09f1c2a, identifier: 116931547
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Fff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2026-01-28 19:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2026-01-28 19:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547 to the API
2026-01-28 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116931547?view=catalogue>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GREEN',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Electric Hybrid',
'id': 'a1553c78-f1c2-570a-880a-7632c09f1c2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RO25DUH',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116931547',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'KIA',
'model': 'SPORTAGE ESTATE',
'odometer': 19983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-27',
'seller_name': 'Liquid Fleet',
'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
'transmission': 'automatic',
'trim': '1.6T GDi 207 HEV 3 5dr Auto',
'vin': None,
'year': 2025}
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [astonbarclay.gb] INFO: Saving data for 116931547: {'auction_closing_time': 1769680800.0, 'created_time': 1767986478.388379, 'last_price_update_time': 1769627146.514545}
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116931547') HTTP/1.1" 204 0
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fbdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919f2f90>
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fa8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904cf490>
2026-01-28 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Ff1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318377f610>
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Ffd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fd371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fa6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fcbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600 not downloaded yet
2026-01-28 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31919d7950>
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31904a0210>
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_0.jpg HTTP/1.1" 201 0
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190107f50>
2026-01-28 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_1.jpg HTTP/1.1" 201 0
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fbdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31905391d0>
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902ad6d0>
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Fff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118838708?view=catalogue)
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318374d210>
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_2.jpg HTTP/1.1" 201 0
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fa8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3191665810>
2026-01-28 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_3.jpg HTTP/1.1" 201 0
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/118333789?view=catalogue)
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31902f3990>
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_4.jpg HTTP/1.1" 201 0
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f318360e8d0>
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_5.jpg HTTP/1.1" 201 0
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fd371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190239c50>
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fa6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3193bb5ad0>
2026-01-28 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3196714cd0>
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f319028b190>
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_6.jpg HTTP/1.1" 201 0
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252F83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f31918fd410>
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY74OLW%252F2026-01-28%252Fimage%252Ffd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46
2026-01-28 19:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1de7e3f2-30b1-53b9-863b-6fae024b0e46, skipping ID generation
2026-01-28 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with scrape type 1
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1de7e3f2-30b1-53b9-863b-6fae024b0e46 from tracking dictionaries
2026-01-28 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1de7e3f2-30b1-53b9-863b-6fae024b0e46 sending to next pipeline
2026-01-28 19:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1de7e3f2-30b1-53b9-863b-6fae024b0e46, identifier: 118838708
2026-01-28 19:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with identifier: 118838708
2026-01-28 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with identifier: 118838708
2026-01-28 19:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1de7e3f2-30b1-53b9-863b-6fae024b0e46 with identifier: 118838708 to the API
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 17,
'color': 'BLUE',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol/Plugin Electric Hybrid',
'id': '1de7e3f2-30b1-53b9-863b-6fae024b0e46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GY74OLW',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118838708',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'TOYOTA',
'model': 'PRIUS HATCHBACK',
'odometer': 8379,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31049,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/2e1b2d7a-75f4-41fa-9c61-6c7459c7872a_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34508,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/3bf2973f-313a-4970-86f9-05a31a47a243_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35831,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/f1eacaed-2cd0-4b34-a1a2-3821ab851042_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33893,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/77f856e0-70c6-45d9-bb5b-e4c67e444ed6_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44503,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/818a84a4-0732-4119-9703-6b82aa7117bf_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58235,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/ff805bb8-4e1f-440a-b3a8-345b6d3db8b7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71484,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/83526ef1-08dd-4e7a-8963-0c113e86b9ee_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61926,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4d9b4613-51c8-406b-a0ff-06a39ce3a71b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59145,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/4fb73cfe-b06e-48ad-93e9-f184e4abb84b_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de7e3f2-30b1-53b9-863b-6fae024b0e46/1de7e3f2-30b1-53b9-863b-6fae024b0e46_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92707,
'Height': 800,
'OriginUrl': 'https://abimg003.imgix.net/GY74OLW/2026-01-28/image/fd7679ee-abbb-4951-9bc9-a85b949188eb_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-27',
'seller_name': 'Zenith',
'title': 'TOYOTA PRIUS HATCHBACK 2.0 PHEV Excel 5dr CVT',
'transmission': 'automatic',
'trim': '2.0 PHEV Excel 5dr CVT',
'vin': None,
'year': 2025}
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118838708%27 HTTP/1.1" 200 None
2026-01-28 19:05:51 [astonbarclay.gb] INFO: Saving data for 118838708: {'created_time': 1769627151.504845, 'last_price_update_time': 1769627151.504856, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118838708') HTTP/1.1" 204 0
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190365750>
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_7.jpg HTTP/1.1" 201 0
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190057fd0>
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_8.jpg HTTP/1.1" 201 0
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252F5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3190055b90>
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_9.jpg HTTP/1.1" 201 0
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH25CKE%252F2026-01-07%252Fimage%252Fcbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600 saved to cache
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083
2026-01-28 19:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22d03fd5-1541-5fc6-9bd6-312fd74a5083, skipping ID generation
2026-01-28 19:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with scrape type 1
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22d03fd5-1541-5fc6-9bd6-312fd74a5083 from tracking dictionaries
2026-01-28 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22d03fd5-1541-5fc6-9bd6-312fd74a5083 sending to next pipeline
2026-01-28 19:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22d03fd5-1541-5fc6-9bd6-312fd74a5083, identifier: 118333789
2026-01-28 19:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with identifier: 118333789
2026-01-28 19:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with identifier: 118333789
2026-01-28 19:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 22d03fd5-1541-5fc6-9bd6-312fd74a5083 with identifier: 118333789 to the API
2026-01-28 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 19:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GREY',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'expiration_date': '2026-01-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '22d03fd5-1541-5fc6-9bd6-312fd74a5083',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'YH25CKE',
'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/118333789',
'listing': 'auction',
'location': 'Aston Barclay Donington Park',
'make': 'NISSAN',
'model': 'JUKE HATCHBACK',
'odometer': 18342,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32765,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/7b7f4747-9334-424d-b9c2-19010bc7e0f9_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33777,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/bdaf2c5b-28c6-46db-8553-02fbd1d279fb_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32700,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a8047eae-e5c7-4e73-9f90-9f42d7f8fea7_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32987,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5d07a98c-e5b8-4bf2-bc73-7119c6627c18_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43673,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/66574a0a-cb7e-4b6b-b869-6116b41c76db_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50282,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/d371d07e-508b-4328-8dc5-c751bda5432f_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39555,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/a6bd2a00-f79f-4b57-8654-501badc940e0_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53453,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5cd62017-a9fa-4d0c-a757-c692b1c6d35e_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46844,
'Height': 450,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/5a08b5d6-b780-4977-a3bb-5ab5ec29c103_removebg.jpg?w=600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d03fd5-1541-5fc6-9bd6-312fd74a5083/22d03fd5-1541-5fc6-9bd6-312fd74a5083_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64503,
'Height': 800,
'OriginUrl': 'https://abimg003.imgix.net/YH25CKE/2026-01-07/image/cbc3338a-ecdb-400c-9ab2-30f0f02e95b3_removebg.jpg?w=600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-10',
'seller_name': 'Liquid Fleet',
'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T Acenta Premium 5dr',
'transmission': 'manual',
'trim': '1.0 DiG-T Acenta Premium 5dr',
'vin': None,
'year': 2025}
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118333789%27 HTTP/1.1" 200 None
2026-01-28 19:05:53 [astonbarclay.gb] INFO: Saving data for 118333789: {'created_time': 1769627153.512456, 'last_price_update_time': 1769627153.512467, 'auction_closing_time': 1769680800.0}
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118333789') HTTP/1.1" 204 0
2026-01-28 19:05:53 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 19:05:53 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 5, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 4}
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723618%27 HTTP/1.1" 200 None
2026-01-28 19:05:53 [astonbarclay.gb] INFO: Saving data for 118723618: {'created_time': 1769627153.632321}
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118723618') HTTP/1.1" 204 0
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27118723655%27 HTTP/1.1" 200 None
2026-01-28 19:05:53 [astonbarclay.gb] INFO: Saving data for 118723655: {'created_time': 1769627153.660655}
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118723655') HTTP/1.1" 204 0
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201769195153 HTTP/1.1" 200 None
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118896503') HTTP/1.1" 204 0
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118925424') HTTP/1.1" 204 0
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118926355') HTTP/1.1" 204 0
2026-01-28 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='118939468') HTTP/1.1" 204 0
2026-01-28 19:05:53 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (153 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2026-01-28T19_00_00.jl
2026-01-28 19:05:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 549479,
'downloader/request_count': 890,
'downloader/request_method_count/GET': 890,
'downloader/response_bytes': 29356021,
'downloader/response_count': 890,
'downloader/response_status_count/200': 890,
'elapsed_time_seconds': 348.219243,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 1, 28, 19, 5, 53, 826331, tzinfo=datetime.timezone.utc),
'item_dropped_count': 100,
'item_dropped_reasons_count/DropItem': 100,
'item_scraped_count': 153,
'log_count/DEBUG': 10826,
'log_count/ERROR': 76,
'log_count/INFO': 10799,
'memusage/max': 179957760,
'memusage/startup': 127270912,
'photo_download_count': 633,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 77,
'playwright/request_count/aborted': 41,
'playwright/request_count/method/GET': 54,
'playwright/request_count/method/HEAD': 12,
'playwright/request_count/method/POST': 11,
'playwright/request_count/navigation': 2,
'playwright/request_count/resource_type/document': 2,
'playwright/request_count/resource_type/fetch': 22,
'playwright/request_count/resource_type/font': 2,
'playwright/request_count/resource_type/image': 29,
'playwright/request_count/resource_type/script': 7,
'playwright/request_count/resource_type/stylesheet': 2,
'playwright/request_count/resource_type/xhr': 13,
'playwright/response_count': 36,
'playwright/response_count/method/GET': 25,
'playwright/response_count/method/POST': 11,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/fetch': 10,
'playwright/response_count/resource_type/font': 2,
'playwright/response_count/resource_type/script': 7,
'playwright/response_count/resource_type/stylesheet': 2,
'playwright/response_count/resource_type/xhr': 13,
'request_depth_max': 3,
'response_received_count': 257,
'scheduler/dequeued': 890,
'scheduler/dequeued/memory': 890,
'scheduler/enqueued': 890,
'scheduler/enqueued/memory': 890,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 256,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 7.065187555803277,
'scrapy-zyte-api/mean_response_seconds': 7.066843849122962,
'scrapy-zyte-api/processed': 256,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 256,
'scrapy-zyte-api/request_args/experimental.requestCookies': 255,
'scrapy-zyte-api/request_args/experimental.responseCookies': 256,
'scrapy-zyte-api/request_args/httpResponseBody': 256,
'scrapy-zyte-api/request_args/httpResponseHeaders': 256,
'scrapy-zyte-api/request_args/url': 256,
'scrapy-zyte-api/status_codes/200': 256,
'scrapy-zyte-api/success': 256,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 1, 28, 19, 0, 5, 607088, tzinfo=datetime.timezone.utc)}
2026-01-28 19:05:53 [scrapy.core.engine] INFO: Spider closed (finished)